СЦ 


М 


[uer ^ Ego 3 


T 
hte. 


t dgn Noj 


РАС 


* 
En Pisa ч 
a LAM 19: 


McGraw-Hill Publications in Psychology 


Cuirrorp T. Morean, Consulting Editor 


INTRODUCTION TO 
EXPERIMENTAL METHOD 


McGraw-Hill Series in Psychology 
Currronp T. Morgan, Consulting Editor 


——————ÓÀ——— 


Barker, KouxiN, AND Wricur - Child Behavior and Development 
Barruey - Beginning Experimental Psychology 
Віом - Psychoanalytic Theories of Personality 
Brown · Psychology and the Social Order 
Brown - The Psychodynamies of Abnormal Behavior 
Carre. - Personality 
CRAFTS, ScuNEIRLA, ROBINSON, AND GILBERT - Recent Experiments in Psychology 
Derese - The Psychology of Learning 
DoLLARD AND MILLER - Personality and Psychotherapy 
Dorcus AND Jones - Handbook of Employee Selection 
Fercuson · Personality Measurement 
Сніѕкілл AND Brown - Personnel and Industrial Psychology 
Gray - Psychology Applied to Human Affairs 
Gray - Psychology in Industry 
Gurtrorp - Fundamental Statistics in Psychology and Education 
GuriLronp · Psychometric Methods 
Hırs · The Measurement of Hearing 
Нингоск - Adolescent Development 
Hunrock - Child Development 
Hunrock - Developmental Psychology 
Jounson - Essentials of Psychology 
KanN AND GILMER - Readings in Industrial and Business Psychology 
Krecu AND CRUTCHFIELD - Theory and Problems of Social Psychology 
LEWIN - A Dynamic Theory of Personality 
Lewy - Principles of Topological Psychology 
Mater - Frustration 
MAIER AND ScuNEIRLA · Principles of Animal Psychology 
Miter * Experiments in Social Process 
Miter · Language and Communication 
Moors · Psychology for Business and Industry 
MORGAN AND STELLAR - Physiological Psychology 
Pace - Abnormal Psychology 
REvwEnr - Feelings and Emotions 
Tucnanps - Modern Clinical Psychology 
SEASHORE - Psychology of Music 
Sewarp - Sex and the Social Order 
SHAFFER AND Lazarus - Fundamental Concepts in Clinical Psychology 
Sracner - Psychology of Personality 
TowNSsEND - Introduction to Experimental Method 
VINACKE + The Psychology of Thinking 
Wau · Personality Maladjustments and Mental Hygiene 
ZUBEK AND SOLBERG - Human Development 
John Е. Dashiell w: 


as Consulting Editor of this series from its inception in 1931 
until January 1, 1950, 


INTRODUCTION TO 
EXPERIMENTAL METHOD 


For Psychology and the Social Sciences 


JOHN C. TOWNSEND, Ph.D. 


Associate Professor of Psychology 
West Virginia University 


New York Toronto London 
McGRAW-HILL BOOK COMPANY, INC. 
1953 


INTRODUCTION TO EXPERIMENTAL METHOD 


Copyright, 1953, by the McGraw-Hill Book Company, Inc. 

Printed in the United States of America. All rights reserved. 

This book, or parts thereof, may not be reproduced in any 
form without permission of the publishers. 


Library of Congress Catalog Card Number: 53-5177 


п 


THE MAPLE PRESS COMPANY, YORK, PA. 


Dedicated to 


Косев W. RUSSELL 
Head, Department of Psychology, 
University College, London, 
my friend and former 
professor 


PREFACE 


This is a book that should appeal to three overlapping categories of 
individuals. First, the undergraduate student who is undergoing his first 
exposure to the rigors of the experimental method in psychology and the 
social sciences. Second, the student who, with an inadequate back- 
ground in the application of the experimental method, finds himself 
faced with the necessity of “doing a piece of research" to satisfy thesis 
requirements. Third, the social science worker who discovers that his 
job in industry, the clinic, the prison, etc., is one demanding the execu- 
tion of research projects. 

At the outset, I would like to state my main purpose in writing this 
book. It has become increasingly clear to me, and to other teachers in 
the area of experimental psychology, that there is a need to develop in 
students an early appreciation of the theory of scientific method and 
statistics. In the past, laboratory courses in general experimental 
psychology offered, largely, a type of training based on what may be 
known as a “cookbook” method. The students were given complete 
directions for performing a certain experiment and were required only 
to follow the directions given, fill in the blanks with the appropriate 
words and phrases, and write their conclusions. Such experiments, if 
they can be called that, did not call upon the student to demonstrate his 
ability to design experiments but only to carry out those already designed. 
He spent most of his time in the laboratory serving as a subject for experi- 
ments and not as an experimenter. In a sense, such a program trains 
the student to be a good subject and does not further him toward the 
supposed ideal of receiving training as an experimenter. 

The emphasis in this book is placed on preparing the student to 
think along lines of the development of sound research designs rather 
than the successful execution of standardized traditional experiments. 
In this way, it is believed that the beginning student may be exposed to 
the elements of theory and method necessary for the understanding of 
the performance of experiments. Equally important, the student -will 
be given the opportunity to become sensitive to the ways of critical 
thinking early in his contact with science and not be forced to labor in 
darkness and boredom until he becomes a graduate student. I believe 
theory and content can be successfully taught simultaneously. 

This book, an introductory text, is written for the student, in his 
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language, and in line with his preparation for beginning a course of study 
in research design and statistical methods. No attempt will be made to 
cover completely all the methods or statistics used by the more advanced 
students in experimental psychology. Often, as is true when concepts 
are greatly simplified, much of the preciseness and beauty of the topic 
discussed will be lost. This is the inevitable consequence when any- 
thing less than the whole of a topic is presented; however, since I wrote 
this book for the purpose of making my subject matter clear to the 
student, I offer no apology for simplicty and repetition. 

Appreciation is expressed to Drs. Raymond J. Christman, Ann Green- 
hut, and Quin F. Curtis of West Virginia University who read and con- 
structively criticized parts of the manuscript. To my brother, George W. 
Townsend, goes my thanks for his contributions to the chapter on appara- 
tus. Dr. Roger W. Russell, University College, London, will recognize 
many of his contributions as he reads this book, for it was he who first 
told me the story of the experimental method. For his thought-provok- 
ing lectures I am eternally grateful. 

I am indebted to Prof. Ronald A. Fisher, Cambridge, and to Messrs. 
Oliver and Boyd, Ltd., Edinburgh, for permission to reprint Tables 3, 4, 
and У.А. from their book "Statistical Methods for Research Workers" 
and to the many other publishers and authors who granted permission 
to use their materials. 


Last, but not least, I thank Mrs. Barbara Boggs, who deciphered and 
typed the manuscript. 
Joun C. TOWNSEND 
Morgantown, W. Va. 
March, 1953 
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PART A 
THEORY OF EXPERIMENTATION 


CHAPTER 1 


PSYCHOLOGY AND SCIENCE 


Since the earliest recorded event in history, man has attempted to 
inquire into the what, how, and why of not only his existence, but also the 
existence of almost all things with which he has come in contact. From 
man’s experience, driven by insatiable curiosity, has come the bundle of 
facts we call knowledge. 


Science and Mysticism 


The most exacting, direct, and efficient means by which facts have been 
collected and organized is by the use of tools of thinking and acting which 
have come to be known as scientific methods. But man has not always 
been scientific in the way he went about attempting to explain phenomena 
in nature. Не has often, when baffled as to the cause of an event, resorted 
to attributing power over natural events to pagan gods. 

If a primitive man saw lightning strike a tree and a fire result, he would 
be at a loss to explain the phenomenon in terms of the source of lightning 
and the chemistry of combustion." Because of lack of knowledge, he 
would not be able to explain the event satisfactorily in terms of the factors 
involved in the event itself. Instead, to find the cause, he would turn 
away from the event and go outside it to some hypothesized external 
agent. He would probably invent a god of lightning and a god of fire as 
the cause of the occurrence. 

As man has progressed in his knowledge of the relationships of nature, 
he has felt less and less need to hypothesize mystical external agents as 
Causes of natural phenomena. It is through the gaining of more and 
more facts of nature that man has slowly replaced ignorance, governed by 
superstition, with systematic scientific knowledge. A further discussion 
of this line of thought is to be found in the writings of Zilboorg and Henry 
(15, р. 27).! 

Let us notice Fig. 1.1. The scientist works only within areas I and II. 
When he attempts to deal with area III, he becomes a mystic and a 
Scientific renegade. Science attempts to enlarge area I and eliminate 


1 Numbers in parentheses throughout this book refer to the bibliography found at 


the end of each chapter. 
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areas II and III. Since the work of the scientist is to find answers to 
problems by the method of determining the truth or falsity of testable 
hypotheses, he spends most of his time in area II. © 

The following example may further clarify the concept of the legitimate 
areas of scientific endeavor. Suppose a scientist’s attention is called to 
an unexplained event which we will name event X. He is asked to find 
an acceptable scientific explanation for event X. 


Just where is event X 
located in the chart, Fig. 1.1? 


Event X cannot be in area I, for this area 


AREA OF 
VALIDATED 
HYPOTHESES 

SCIENTIFIC 
KNOWLEDGE 


AREA OF TESTABLE HYPOTHESES 
NOT YET VALIDATED 


SCIENTIFIC PROBLEMS 


AREA OF NONTESTABLE HYPOTHESES 
(impossible to validate) 


MYSTICAL EXPLANATIONS 


Fic. 1.1. The relationship of scientific knowledge, scientific problems, and mystical 
explanations. 


contains only that knowledge which h 


technique of validating hypotheses, and we said we have no known 
scientific explanation for event X. Event X cannot be located in area 
III, for this area contains only nontestable hypotheses or mystical expla- 
nations for events. The scientific explanation of event X must rest in 


area ТТ, for this area is reserved for problems in need of scientific explana- 
tion and whose explanation is to be discovered by the process of testing 
the validity of hypotheses, 


as been gathered through the 


в search for meaningful explana- 
size while area III has decreased. 
, it has become 
our present knowledge, has made us m 
for explanations in terms of testable h 
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problem most often suggests another problem.  Northrop's (11) dis- 
cussion of the analysis of the problem facing the scientist is relevant 4 


Definition of Scientific Psychology 


Psychology itself grew from a varied background. It progressed from 
the mystical to the scientific stage during its long history. One of 


psychology’s most prominent ancestors was philosophy. It was not until == : 


1879 that psychology became dignified by having a laboratory dedicated 
to psychological research. See Bartley (2, p. 3) for a good, short history 
of psychology. 

Regardless of the strides made by scientific psychology there are many 
today who would deny that psychology is a science. Psychology is a 
science, but only under certain conditions. Let us see when psychology 
is and when it is not a science. 

Almost no one will disagree with you if you affirm that chemistry, 
physics, and biology are sciences. Now it is obvious that the subject 
matter of each of these sciences is different. Chemistry treats of the 
composition of substances and their changes. Physics deals with the 
phenomena of inanimate matter involving no changes in chemical com- 
position, and biology is the science which treats of living organisms. 
Therefore, we can say that science, whatever it is, is not defined in terms 
of the subject matter with which it deals. What, then, is a science? 

The definition of science does not rest on what is accomplished, but how 
it was accomplished. The important factor present when science is 
present and absent when science is absent is the factor, scientific thinking. 
To define science as “апу body of organized knowledge which has been 
gathered through the use of systematic methods of investigation” is close 
to the true definition, but only if the emphasis is placed on the method of 
investigating and not the materials investigated. 

Scientific thinking is a particular kind of thinking. It has two major 
characteristics. These are direction and control. Above all, scientific 
thinking represents organized, orderly, methodical thought concerning 
the issues at hand. The common factor, then, running through all 
accepted sciences, is the method by which facts concerning a certain class 
of phenomena are gathered. If this is so, then there is no reason for 
excluding psychology from the list of sciences just because its subject 
matter is often of an intangible nature. So long as facts concerning the 
consciousness and behavior of organisms are gathered in accordance with 
the rules of scientific methodology, then such facts form an organized 
body of knowledge that meets every specification of a science. Con- 
versely, psychology is not а science when its data are gathered and 
evaluated by unorthodox methods which break the rules of logic. Ruch 
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(12, p. 3), Munn (10, p. 3), Cruze (8, p. 6), and Bugelski (4, p. 3) discuss 
psychology as a science. 


Common Sense and Scientific Thinking 


The layman when presented with a problem will often attempt to 
answer it by "common sense,” while the scientist would prefer to use 
scientific methods. Is the common-sense approach really different from 
the scientific approach? The answer is that the scientific methods grew 
out of the common-sense approach. In the growing process, Stebbing 
(18, p. 235) believed two major changes took place. First, common sense 
became organized to a high degree, and, second, there was a change in the 
type of order with which it dealt. The common-sense approach is 
usually an attempt to solve a problem by simply ruling out those factors 
which do not form an acceptable answer and taking as the answer that 
factor or circumstance which most completely accounts for the incident, 
The following is an example used by Stebbing (13) in a discussion of 
common-sense thinking: 


Suppose that a man, having left his flat empty, returns in the early evening to 
find his front door bolted. Не knows that he left по one in the flat. How, then, 
account for the bolted door? That burglars have broken into the flat is the first; 
idea likely to occur to a Londoner. The suggestion springs into his mind almost 
before he has had time to reflect. But then a difficulty arises to check the 
acceptance of this idea. How could a burglar have left the door bolted on the 
inside? The flat is on the third floor of a straight-faced block, so that it is 
improbable that the entry should have been made through a window. Perhaps 
the bolt has slipped. But that idea is immediately rejected, since it is a stiff, 
horizontal bolt rarely used. Some one inside must have drawn the bolt. Having 
succeeded in forcing the door, he inspects the flat, looking for confirmation of his 
suspicion. There is no one in his study, but he finds the drawers of his desk 
open and their contents scattered. There was, he knew, no money in the desk, 
so he does not pause to examine the drawers, but goes at once to the dining-room 
to inspect the silver. He finds that two silver cups have gone and also that the 
table silver has disappeared. These facts are ample confirmation of his belief 
that he has been robbed. But there is still the puzzling fact of the door bolted 
on the inside. As he walks down the passage he sees a light under the kitchen 
door. Perhaps the burglar is still in the flat. But the kitchen is empty. On 
the table are the remains of a meal. The window is wide open. He remembers 


the parcels lift and now feels that the situation is explained. Whatever the 


means of entry, the exit has been by way of the parcels lift. The bolted front 


door was doubtless to give the burglar time to escape should the owner of the 
flat return too soon. 


1 Stebbing, L. S., A Modern Introduction to Logic, pp. 233-234, The Thomas Y. 
Crowell Company, New York, 193 


0. Reproduced here with the kind permission of 
the publishers. 
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Would the scientist treat this example in a different way?  Essen- 
tially, no. Both the scientist and the common-sense thinker would 
attempt to collect and organize the facts in such a way as would provide 
an explanation. 

The differences between common-sense thinking and the scientific 
approach become more obvious when a specific, easily observed, everyday 
phenomenon occurs and an explanation is demanded. Let us take as an 
example the apparent fact that memory for an event usually fades as time 
goes on. Chances are the layman has seldom thought about this ordi- 
nary happening. If his attention is directed to the phenomenon and he 
is asked to explain the reason for it, he might say, “It’s just common 
sense that if you don’t use the material you have learned, it disappears 
because of disuse.” In his opinion he has cleverly answered your ques- 
tion and wonders why you could not have figured it out for yourself. 
But you, as a scientist, are not satisfied with this common-sense answer 
to what appears to him to be a simple, obvious answer to a commonplace 
question. So you decide to check and see if disuse alone can cause a 
fading of memory. Perhaps, as much of a surprise to both of you, you 
discover that it is not disuse alone that causes the memory fading, but 
rather it is mostly the so-called retroactive inhibition effect of learning 
during the interval between the original learning and the recall. A quick 
look in any good psychology-of-learning text would have told you the 
same thing. The experiment has not only shown that “common-sense” 
thinking can be wrong, but has demonstrated that the scientific approach 
can take a usual occurrence, find a verifiable answer for it, and, further, 
can suggest other hypotheses and solutions. Common-sense thinking 
alone seldom is able to do this. 

The usual differences between the two approaches are these: the com- 
Mon-sense thinker is satisfied with an explanation that merely satisfies 
his immediate curiosity, while the scientist attempts to systematize the 
facts so that he may go beyond the obvious explanation. The layman 
feels the need for providing an explanation for only unusual happenings. 
The scientist feels the need of explaining any event, unusual or ordinary. 
Thus we see how the scientist differs from the common-sense thinker 
in both the way and degree to which he organizes the explanation and 
the type of events to which his curiosity extends. In addition, the 
Scientist, because of his training in dealing with problems, introduces 
other elements when he deals with problem solution through the process 


of experimentation. 
Woodworth (14) states: 


An experimenter is said to control the conditions in which an event occurs. 
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He has several advantages over an observer who simply follows the course of 
events without exercising control. 

(a) The experimenter makes the event happen at a certain place and time and 
so is fully prepared to make an accurate observation. 

(b) Controlled conditions become known conditions, the experimenter can 
set up his experiment a second time and repeat the observation. . . . 

(c) The experimenter can systematically vary the conditions and note the 
concomitant variation in the results. . . .! 


The layman is not expected to offer any more than common-sense 
answers. The scientist is. Much of the damage done to psychology as 
2 profession, and to those who come seeking psychological help, is done 
by the self-styled “psychologist” who may be only a layman with a 
common-sense knowledge of psychology. The scientific psychologist 
should demand the best thinking possible from himself and colleagues 
and should make use of only those explanations arrived at by a sound 
scientific approach. 


Logic and Science 


Two major overlapping logical systems have been set down for use as 
guiding rules for the scientist. These Systems are known as (a) inductive 
and (b) deductive logie. See Bugelski (4, p. 46), Black (3, pp. 13, 291) 
and Andrews (1, p. 2). 

Inductive logie assumes that the researcher begins his investigation by 
observing certain, separate instances of the occurrence of whatever 
phenomenon he is investigating. He observes measures and records 
these occurrences. Then, by examining the bundle of concrete data 


J 


a statement, or proposition, 
‹ the group from which the separate 
instances represented a sample. This is the inductive method. 


This concrete truth is called a deduction. 
ce that is believed to be valid and con- 
5 preceded by “logical” reasons which 


by deductive logie in the scientific 
logic starts with the observation of 


1 Woodworth, R. S., Experimental Psychology, p. 2, Hen: 


New York, 1938. Reproduced here wit d a Company, Ine, 


h the kind permission of the publishers, 
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scientific methods of experimental inquiry are most heavily indebted to 
the inductive method. Validation of the results of experimentation owes 
its debt to deductive logic. 

The following chart, Fig. 1.2, illustrates the relationship of the two 
systems of logic. 

Cresswell (7) uses the following syllogism when attempting to represent 
logical inference symbolically. 

Hypothesis: If A is B, then C is D. 

Experimentation: Observation or experimentation shows that C is D. 

Deduction: If there is no alternative explanation, A is probably B. 


INDUCTION DEDUCTION 
CONCRETE DATA GENERALIZATION CONCLUSION 
A certain percentage Removal of a certain 4 Removal of a 
of the cerebral percentage of the certain percentage 
cortex was removed cerebral cortex in of the cerebral cortex 
from a sample of monkeys is related in monkeys is related 
monkeys. Their. to a significant to a significant decre- 
memory was signif- decrement in memory ment in memory function. 
icantly impaired. function. (Premise I) 

2. Jo-Jo is o monkey 
not yet operated upon. 
(Premise II) 

3. Therefore removal 
of о certain percentage 
of Jo- Jo's cerebral 
cortex will be related 


fo о decrement in his 
memory function. (The 
Deduction). 


Fic. 1.2. The relationship of inductive and deductive logic. 


. This syllogism could be applied to Torricelli’s work leading to the 
Invention of the barometer. If it were true that air has weight (A is B), 
then a column of mercury should be higher at sea level than on top of a 
mountain (Cis D). It was demonstrated that a column of mercury stood 
higher at sea level (C is D), thus air probably has weight (A is B). 

Many scientific psychologists refuse to accept the psychoanalytic 
theory because it makes use of, and, indeed, is built upon certain non- 
testable hypotheses. The libido, id, ego, superego, etc., are postulates 
that have come into being in order to help explain human behavior. 
Because such concepts cannot be dealt with by rigid experimentation, 
they have been relegated, by some, to the area of nontestable hypotheses 
Which we have labeled “mystical explanations." 

Mystieal explanations are so easy to invent and are so often logically 
Self-consistent that it takes a firm believer in the scientific method 
"PDroach to point out the fallacies. If the basic postulates are not capa- 

le of being proved or disproved, then any system of logical explanation 
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built on them may be either right or wrong. If the premises are false, 
then all that follows is wrong, since the logical deductions would of neces- 
sity be consistent with a false premise. On the other hand, the basic 
premises assumed may be right, and in that case the system evolved 
would be a true system. 

The psychoanalysts say that their basic postulates are sound because 
the system “works.” What they mean by this is that their deductions, 
when applied, work in the specific instances noted, and that the cures by 
psychoanalysis follow a logically expected sequence consistent with the 
system. That the system probably works is denied by few who have 
witnessed its application, but what worries the scientific psychologist; is 
how it works, in that other explanations of the cures by psychoanalysis 
are possible wherein the postulates of psychoanalysis need not even be 
mentioned. Such are the difficulties of understanding a system built on 
nontestable hypotheses. 

Most psychologists have chosen as their approach to the study of human 
behavior some system which is akin to behaviorism. This means study- 
ing the human being as an organism that has the capabilities of receiving 
stimuli, integrating these stimuli, and responding accordingly. In such 
a system of behavior explanation, one need not hypothesize forces other 
than those he can measure and manipulate. Such a system has its 
beginning in the observation of an organism’s reactions to its environment 
and heredity. Such observations yield verifiable data from which 
premises may be made. The scientific psychologist may then deduce 
from these premises certain valid truths. An example of an explanation 
of the principles of behavior as deduced from behavioristic data is to be 
found in Hull’s work (9). 

The psychoanalytic theory may be as true an explanation of human 
behavior as any other, but its system of explanation is more doubted by 


the scientific psychologist than systems that make less use of nontestable 
hypotheses. 


Scientific Steps from Observation to Generalization 


If we agree that the correct approach to the solution of a problem is by 
progressing through the inductive-deductive path, then our itinerary is 
well marked for us. Most researchers follow the four following steps in 
doing a piece of scientific research aimed at arriving at facts. N orthrop 
(11, р. 34) presents a related discussion. 

Observation. The researcher, during his contact with his field of study, 
is constantly alert through the process of observation for the detection of 
apparent relationships among factors. When such relationships are 
suspected, he prepares to go through the process necessary to account for 
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these relationships. He will wish to connect any fact observed with a 
total situation so as to bring the isolated fact into a meaningful light. 

Classification. A researcher does not jump into a research project 
without selecting some frame of reference from which to view his data. 
He may decide to discover the reason for a particular type of behavior in 
human beings but he still must further decide which frame of reference he 
will use. If he is a psychologist, he most likely will view his subjects, and 
thus classify his data, in a different fashion than would a physiologist, a 
biochemist, or an endocrinologist. During the classificatory stage, the 
Scientist will guess at the cause of the relationships and make what is 
known as a hypothesis. A hypothesis is in itself a form of classification 
of the impression made as the result of observation. 

A biologist may literally classify a number of specimens he has collected 
in terms of traits they possess in common with existing categories, and 
thus gain scientific knowledge of the specimens through this process of 
Classification. See Northrop (11) and Cohen and Nagel (6, p. 223). 

Verification. Having observed the problem and having made it mean- 
ingful in terms of a particular discipline, the researcher proceeds to design 
an experiment to test the validity of certain answers he has suggested. 
During the experimental stage leading to verification the researcher con- 
trols the conditions in which the phenomenon occurs. He varies only 
that factor or those factors whose influence he wishes to measure as 
related to other conditions. Data are thus gathered that will serve as the 
basis for derivation of propositions arrived at by the process of induction. 

Generalization. On the basis of having established that certain factors 
are responsible for the phenomenon observed, the experimenter states 
Certain general inferences, principles, theories, or laws. He then deduces 
from these propositions certain statements relating them to specific 
occurrences of the phenomenon. 

These four steps are utilized by science and are the basic elements in 
the logical progression in man’s attempt to establish an orderly and sys- 
tematic knowledge of natural phenomena by scientific means. The most 
important step is verification. ‘The most dangerously difficult step is 
Beneralization. 

Thus psychology proceeds along a difficult road full of pitfalls and 
armed only with a method that will, if faithfully followed, safely and 
efficiently carry it through to the maximum amount of reliable knowledge 


1 the area of scientific psychology. 


Pure and Applied Science 


If a scientist is engaged in attempting to establish certain scientific 
laws as a result of the investigation of basic relationships between phe- 
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nomena, then he may be said to be doing pure scientific research. A 
synonym for pure research is fundamental research. The reason for 
doing pure research is to gather facts for the simple reason that facts are 
worth gathering. Whether the facts are of immediate use in solving an 
existing problem or whether they may not be needed for a hundred years 
is of no concern to the pure researcher. He knows that all things in 
nature are related and that any new fact discovered will fit into the general 
scheme. 

The “pure” researcher adds to our stock pile of information. He most 
often works on his own, unsupported, and follows his own inclination in 
the choice of research problems. Ebbinghaus was doing pure research in 
psychology when he gathered data on which to build his laws of learning, 
He was not meeting a current problem of his time, for his work assumed 
importance only after introspective psychology changed to applied 
psychology. 

The “applied” scientist conducts experiments during which time he 
applies some basic law or laws of science to ascertain what will happen in 
He attempts to answer а, prob- 
lem which is at the time in need of an answer. Chapanis, Garner, and 
Morgan (5, p. 10) point out the two kinds of application of fundamental 
Applied research has to do with the 
in gathering information in specific 
е in this case are used to answer a 
applied science in design means the 


in a particular area, 15 supported by th 
not have freedom in the choice of his r 
chologists at work today experimentin 


To do acceptable research in psychology places more demands on the 
experimenter than if he were experimenting in any of the other fields of 
science. If he is conducting an experiment in chemistry, he may walk 
about hislaboratory and pick up or put down the materials with which he 
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and purity of his salts are the same from bottle to bottle. The physicist 
can measure accurately the factors involved in his experiment. Heat, 
light, electricity, and mechanics all are capable of being highly controlled. 
The physicist сап duplicate the conditions of his experiment just as aceu- 
rately as can the chemist, for such variables as temperature and pressure, 
which might vary from experiment to experiment, or even during a single 
experiment, can be kept constant at any desired value. But not so for 
the psychological experimenter. He must deal with living organisms who 
have as their most common characteristic the accumulation of different 
experiences. No two individuals are alike, nor is any individual the 
same a moment after it has been established what he is like. The human 
being just will not stand still psychologically. Behavior is extremely 
variable. 

The experimental psychologist does not deal with things such as chemi- 
cals or hot and cold metals; instead he deals most often with intangibles 
in the form of inferred “things,” such as learning, personality, intelli- 
gence, and motivation. These intangibles are sometimes called inter- 
vening variables. An example will clarify this latter term. 

A psychologist may decide to do a maze learning experiment wherein 
he will attempt to motivate his rats by depriving them of food for 24 
hours. After 24 hours food deprivation the behavior of the rats is altered. 
They are now highly active and will race through the maze to get to food. 
Their food-seeking behavior has been observed and has been found to 
follow the removal of their normal food supply. Hunger as an interven- 
ing variable is, therefore, inferred from this situation, and the behavior 
of the animal is sa/d to be due to hunger motivation. Actually no one 
could see hunger in rats, but only guess, quite logically, that hunger was 
the major factor motivating the animals. Hull’s (9, p. 21) discussion of 
intervening variables should be consulted. 

In this manner, the psychologist goes about experimenting with these 
unseen variables and treating them as if they were as obvious as the period 
at the end of this sentence. How can the psychologist deal with such 
intangibles? For instance, can he measure intelligence when neither he 
пог anyone else has ever seen it? The answer is simple. We seldom 
Measure things as such in any of the sciences; we only measure their 
effects, Thus, is the problem of the physicist in measuring the effects of 
electrieity much different from the problem of the psychologist in measur- 
Ing the effects of intelligence? No one has ever seen electricity but most 
of us have noted its effects. Measuring instruments for electricity utilize 
the heating effect or the magnetic effect of electricity on metals or wire 
Coils. These effects are then measured and the amount and kind of elec- 
tricity present are inferred from these observations. The psychologist 
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knows that the effects of intelligence are observed through the behavior of 
the individual. The individual who behaves in a way judged to be more 
intelligent is taken to be in possession of more of this inferred “thing” 
intelligence than is someone else who behaves “Tess intelligently.” We 
can see, therefore, that psychology, while it most often deals with vague 
and intangible subject matter, can still gather its data and draw its 
inferences in a method used by the other sciences. 

Although you may now believe that psychology is, and should be, 
recognized as a science and that the problems faced in psychology are 
also found in other sciences, I must stop you to point out that the latter 
is not entirely true. In the other sciences, a scientist observes and 
records the phenomena of nature about him. Itis the picture of a human 
being, or a ‘‘mind” if you choose, observing nonmental or material 
events. Butin the case of the psychologist, there is the picture of a human 
being or mind studying another human being or mind. Thus, the subject 
matter of psychology is made of the same stuff as the investigator, 

Where does this strange situation leave us? The main effect of a 
human being studying another human being is to introduce the proba- 
bility for more errors to creep into the investigation. Less errors are 
probable when a human being studies, for example, a piece of iron. Why? 
First, the investigator in the latter situation will make some errors 
because he ishuman. Regardless of the true size, or weight, or composi- 
tion of the piece of iron, the observer may never more than approximate 
a knowledge of its characteristics. Не can read a scale just so accurately 
and no more. Second, the measuring instrument itself contains more or 
less error in measuring that which it says it measures. These are the 
main sources of error. But the psychologist observing, measuring, and 
recording the behavior of a human being makes not only the usual errors 
of measurement but also makes errors because his subject is changing 
more rapidly than is the piece of iron. The piece of iron does not get, 
hungry, tired, angry, more pleasant, offended, ill, sleepy, bored, or a 
thousand other things which the human being may. Each of these fac- 
tors named has some effect on the individual's behavior and thus intro- 
duces more chance for error to enter the observation, 

There is a type of error in observation which results from the character- 
istics of the observer. When one human being observes the behavior of 
another, the attitudes of the observer in regard to bias, prejudice, projec- 
tion, etc., may introduce errors into the observation. 

Another large source of error in dealing with human beings is made 
when one neglects to equate them in terms of past experience. Since 
each individual has had a different series of experiences and since present, 
behavior is altered in light of past and present experiences, the experi- 
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mentalist in psychology may never make the assumption that two indi- 
viduals can be as much alike as two pieces of iron. Both iron and human 
beings have past and present experiences, but because the human is so 
vastly complicated and is constantly reacting to a multiplicity of chang- 
ing conditions, all nonliving, unconscious things appear relatively stable. 

The psychological researcher who wishes to operate from a scientific 
approach has chosen a rough row to hoe. He should look at himself as 
being a scientist, first, and a psychologist, second. Actually, he is a 
scientist who has simply chosen the behavior of organisms as his topic for 


research. 
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CHAPTER 2 


CAUSAL SEQUENCES AND THE MEANING OF EXPLANATION 


The untrained person is most naive in his concept of what is meant by 
cause and effect. He speaks glibly of this being the cause of that. He 
assumes for the most part, and quite correctly, from a scientific point of 
view, that all events have a cause. But he is prone to assume that there 
is only one cause for an event. In addition, he sometimes jumps to con- 
clusions. For example, many a man has been hanged for murder just 
because he was the only known person present when the victim died, and 
his accusers assumed that he caused the death. You push a light switch 
button and when the light goes on you make the assumption that you 
caused the light to glow. How can one be sure that anything causes any 
other thing to occur? This is an important question for everyday living, 
but it becomes the essential, vital question in experimentation. 


Drawing Causal Sequences 


If one performs an action directed toward altering a situation and a 
change does take place in the situation, then the layman often assumes 
that the act of altering is the cause and the alteration of the situation is 
the effect. But the scientist is only too eager to point out that while you 
may have given an apparent demonstration of a cause-and-effect sequence, 
it has not been proved that what was done caused the effect. Science no 
longer speaks of cause and effect as such; instead, a different concept of 
cause and effect has arisen and is simply called invariant relationship. 
In the above instance, for example, the most the scientist could say is that 
there appeared to be a relationship between the act you just performed 
and the change in the situation. You must be careful in the use of the 
words act and result, or antecedent and consequence for, although they 
imply nothing, some persons infer cause and effect from the use of these 
words. 

Now suppose you repeat the act again and the same change appears in 
the situation. Suppose you repeat the act a thousand times and always 
the same change appears. You would be more and more confident that 
you had caused the effect to appear. The relationship of the act and the 
result would appear to be an invariant relationship. Yet you would not 
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have proved without a doubt that your act caused the effect. For exam- 
ple, suppose you had flicked a light switch on a thousand times and each 
time the bulb lit. You might be willing to wager that the light switch 
you had been flicking turned on the light. It might be both costly and 
embarrassing to you if the person with whom you had bet pointed out 
that he had been secretly turning the light on by means of a concealed 
switch each time you threw your switch on, and, furthermore, the switch 
you had been using was not even connected in the light circuit! 

If one can be so easily fooled, and we all are fooled in a like manner 
many times each day in ordinary pursuits, it is obvious that those who 
would attempt to infer cause-and-effect relationships about complicated 
psychological processes must be sophisticated in the handling of infer- 
ences. The reader should see Cohen and Nagel (2, p. 245) for a further 
discussion of invariant relationships. 


Principle of Determinism 

One who would seek for answers to the problems put forth by the uni- 
verse must have a certain faith. He must believe in, or have faith in, two 
ideas, First, he must believe that all events have a cause. Second, 
he must believe that he is capable of finding these causes. All scientists 
performing research believe thus and act accordingly. A name has been 
given to the first belief mentioned above. It is called the principle of 
determinism. It is possible to believe in the principle of determinism 
without agreeing with the belief that man can know the causes of events. 
However, if one does not also believe that man can find the causes of 
events, then he cannot call himself a scientist. When one carries his 
belief in the principle of determinism into the field of psychology and 
makes the statement that all psychological events have a cause, he is 
affirming psychic determinism. Many persons will agree as to the cause 
of so-called material events but will pull up short when one states that 
the motives of an individual can be investigated by testing certain 
hypotheses. The nonscientific person would rather go to some outside 
force, nontestable, and attribute the desires of human beings to its 
influence, Or he might say desires are caused by something equally 


vague, such as human nature. 


Principle of Multiple Causation 

An event may have not one, but a number of causes. This is the prin- 
ciple of multiple causation. Somehow, we like to simplify things to a 
ridiculous extreme by constantly asking the question, ‘‘ What was the one 
thing that caused this to happen?" Such a question can never be 
answered. A simple example should demonstrate this. Suppose an 
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automobile slid on the wet pavement, going round a curve, and crashed 
into a tree, killing the driver. The newspaper account revealed that the 
driver had left his home immediately following a quarrel with his wife, 
had stopped at a tavern for a few drinks, and had driven rapidly away 
in his dilapidated car. What caused the death of the driver? А few 
possible causes are: emotion, alcohol, speed, poor traction due to wet 
pavement, faulty brakes, steering, etc., loss of blood, broken neck, deteri- 
oration of brain cells due to lack of oxygen, ete. 

Take any event that you can think of and now tell without doubt what 
is the one cause of it. You cannot. 

Referring again to the light switch example used previously and sup- 
posing the switch had been connected, tell what caused the light to glow? 
Was it the switch, or the electricity, or heat, or what? 

Particularly do we run into difficulty in establishing cause-and-effect, 
relationships when we attempt to deal with problems in the social sciences. 
When we think of the many causes of such things as divorce, crime, war, 
prejudice and suicide, to mention only a few, we must indeed be instilled 
with a faith in finding causes if we would venture into the business of 
determining relationships in these areas. 

In the discussion of multiple causation two important related topics 
should be mentioned: necessary and sufficient conditions. Ruby (8, p. 
381) defines a necessary condition as “an event or circumstance which 
must be present in order to get a certain result or effect, but which is not 
sufficient in itself to ‘produce’ the result." Suppose an automobile was 
parked on a steep hill and a child playing within the automobile released 
the emergency brake. The car coasted down the hill and crashed through 
abillboard. Did the release of the brake cause the accident? One might 
say that had the front wheels of the car been turned toward the curb the 
car would not have moved even if its brakes were released. The fact that 
the wheels were not turned toward the curb was a necessary condition for 
the accident to have taken place, but not a sufficient condition in itself 
for causing the accident, Ruby defines a sufficient condition as “опе 


which can, by itself, produce the result, or effect, but which need not be 
present for the effect to occur,” 


would be the following. A child 
stantly prevented from and scold 
into adulthood and demonstrates 
vidual. This type of environment during childhood is perhaps a suffi- 
cient condition to produce a “ 
demonstrated by this adult co 
Thus the sufficient cause might not have been the cause at all. To deal 
intelligently with cause and effect as relationships necessitates that what- 


CAUSAL SEQUENCES AND THE MEANING OF EXPLANATION 19 


ever we say is the cause of an event must not only be a necessary but also 
a sufficient condition for causing the event. A quick glance through the 
chapter on causal analysis by Larrabee (5, p. 271) would supplement this 
discussion. 


Bases for the Assumption of Causal Sequence 


It should be fairly obvious that the relationship of cause and effect is 
difficult if not impossible to prove. Several impressions arise when one 
subjects to close scrutiny that which he usually assumes cause and effect 
to be. 

First, he usually assumes that the cause must precede the effect. How- 
ever, many times effects appear to precede the causes and thus an impor- 
tant relationship may be missed. If a door starts to open before you 
Push on it, you do not assume you opened the door. Yet you might have 
caused the door to open if you had unknowingly broken a light beam that 
interrupted a photoelectric circuit that released a spring that opened the 
door before you touched the door. In this case the effect would have 
appeared to have preceded the cause. 

Second, one assumes a necessary connection between the cause and the 
effect. If a light comes on while you are not touching the switch, but 
merely rubbing your forehead, there is no apparent connection between 
the act and the light coming on. However, a friend, having seen you rub 
your forehead, assumed that your eyes were strained, and turned onthe 
light. In that case the necessary connection was present but not appar- 
ent enough for you to draw a cause-and-effect relationship. As such, the 
cause of the event might easily have been overlooked. 

Third, it soon becomes apparent under close observation that practi- 
cally the only condition always present when you make a causal connec- 
tion is contiguity. By this is meant two things occurring in a direct 
temporalsequence. Ifthe effect occurs directly following your act, and this 
happens regularly, then you do not hesitate to call it cause and effect, 
because the occurrence now fits the definition of an invariant relationship. 

These three bases for the assumption of a causal sequence are part of 
Hume's famous doctrine of cause and effect. Boring (1, p. 191) presents 
а short discussion of Hume's point of view on this topic. 

Sometimes the apparent precipitating faetor occurs and a delay follows 
after which the effect occurs. This is referred to as delayed effects. An 
example would be death following the consumption of a poison. We infer 
4 series of physiological causes and effects finally terminating in the effect 
Called death. Because the taking of the poison and the effect called 
death occurred in a direct, though delayed, sequence, contiguity is 
assumed, although its strict definition is being strained. 
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We see, then, that contiguity is the most important condition we have 
that allows us to make inferences as to causal relationship. Although we 
know now how dangerous it is to make such inferences, it is the best we 
can do, and we must use it in the practical situation. We can and do in 
scientific work avoid the terms cause and effect wherever possible and sub- 
stitute the word relationship instead. This allows the scientist to avoid 
the semantic difficulty involved. When he says relationship, he merely 
means that two events are related in their quantity and temporal appear- 
ance, but not necessarily part of a causal sequence. We shall later show 
how statistics will allow us to quantify the degree of relationship between 
two events and to make statements as to what level of confidence we have 
in the fact that they are related. 


Explanation by Labeling 


Some scientists in the past who have professed faith in the principle of 
determinism and thought they were dealing with testable hypotheses were 
only fooling themselves through a process of word magic. The meaning 
of fooling oneself by word magic is the practice of explaining the cause of 
an event by simply saying it is due to some unknown cause to which one 
has assigned a name. 

The use of the term instinct is an outstanding example of this self- 
deception. Before scientists realized their error in the use of such a term, 
hundreds of causes of human and animal behaviorisms were attributed 
to the vague term instinct. 

During the early 1900’s it was a common and accepted practice to 
explain, particularly, social motives in terms of instincts. Just how was 
the word instinct used? Suppose you, as a student of behavior, asked 
the question, “What causes a particular phenomenon of behavior, A, to 
happen?" Any number of famous social psychologists would have 
answered, phenomenon A is caused by instinct A. They would have 
further said that instincts represent the original force that causes all 
activity in organisms and that without these instincts no behavior of 
organisms would take place. Some of these social psychologists would 
have said that there are 13 major instincts, some more important than 
others. McDougall (6) would have been typical of this group of social 
psychologists. 

But actually, would you know any more about the cause of phenomenon 
A after someone said it was due to an instinct than you did before? No. 
Such explanations are dangerous, for they only cover up our ignorance by 
giving a name to it. When such a means of explaining events is carried 
far enough, one ends up with a knowledge of the causes of events that 
consists of only words that are in great need of explanation themselves. 
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If one accepts as a cause of behavior the mere statement that an instinct 
causes it and goes away satisfied that he now knows the cause, he is indeed 
to be pitied for he knows nothing more now than he did when he asked 
the question. 

Morgan and Stellar (7, p. 402) point out that “аё the present time there 
is no real need for the term instinct, except as a conventional rubric for 
referring to certain kinds of complex motivated behavior.” They further 
remind us that “instincts are under the combined control of stimuli in the 
external world and subtle changes in the internal environment." 

Because the word instinet became a dangerous term to use, some psy- 
chologists began to substitute the words motive and drive. If the words 
motive and drive are used to explain behavior in the same manner as was 
the word instinct, then these words are no better than the word instinet 
and just as meaningless. However, if the user defines his concept and 
shows that the behavior is due to certain existing conditions that his word 
stands for, then he breaks away from the use of the magic of words to 
explain events. Klineberg (4, p. 56) has written an excellent chapter on 
instinct theories and could well be consulted at this point. 

Such word magic is on its way out in psychology, but psychology must 
beware, for such bad actors often play return engagements under different 


stage names. 


Explanation by Stating Purpose 


There are many laymen and, according to some, too many scientists 
who believe in what is known as teleology. Teleology is a system for 
explaining the causes of events in which phenomena are not thought of as 
being determined exclusively by mechanical causes. In other words, 
the cause of an event is not defined in terms of precipitating mechanistic 
principles by teleologists, but rather events are thought to occur because 
they are directed to the final accomplishment of some unified whole. 
Thus, the reason an event occurs is because it must occur to fulfill some 
purpose or to further some superimposed scheme. While it is true that 
much of the behavior of man can be looked upon as occurring to fulfill 
Some purpose and to enable him to reach some end, many careful scien- 
tists will not allow themselves to believe that they are explaining behavior 
by citing the pattern into which such behavior falls. Those who adopt 
this type of purposive explanation may, and often have, ended up by 
Stating sweeping laws which they believe to be universal. Actually, they 
may have led themselves into believing in a nontestable hypothesis as the 
Cause of behavior. A top spinning on the floor might have to spin or else 
it would fall over. But some scientists feel there are better ways to 
explain the reason the top is spinning than to attribute the cause to some 
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purpose the top is fulfilling. If one answers the question, ‘‘ Why does a 
chicken cross the road?" by saying, “То get to the other side,” he is fall- 
ing victim to teleological thinking. 


Explanation by Familiarization 


One group feels that scientific explanation as well as any type of expla- 
nation is aimed at only one goal, that is, to make the unfamiliar more 
familiar. Thus, if one is attempting to explain the cause of any event, he 
must do so by beginning with those things already understood by the 
listener and proceed to the unknown. Ву associating the known with the 
unknown, the unfamiliar becomes familiar. Anything that is necessary 
to further the process of making the unfamiliar familiar is a necessary 
part of an explanation. 


Explanation by Stating the Inferential Procedure 


Another approach would be to say that whenever one has by some 
logical procedure of inference, such as the inductive-deductive method, 
arrived at a truth concerning an event, the scientific explanation of the 
event would involve not only the thing dealt with but also the logical 
steps leading to the inference. Feigl (3) has elaborated on this topic 
and may be consulted for further information. 


Explanation by Description 


Some writers believe that there is no actual difference between descrip- 
tion and explanation. "They would further state that the only way events 
are explained at all is through a process of description. This may be 50, 
for it does seem that science at present is at the descriptive level in its 
evolution. The scientist is called upon not only to tell what causes what 
but how it is accomplished. He is able to perform best when describing 
the events of nature. 

To define an event in terms of an operation or a set of operations is per- 
haps the best description that can be given at the present time. If you 
are asked what effect morphine has on the human being, it might be that 
the best answer you could give would be to describe the changes that take 
place following the administration of the opiate. You could record what 
took place by describing not only your part in the process but also what 
happened to the Subject. You might even advance your idea as to how 
the changes in the subject/s physiological condition came about. But at 
the present time you could not go much further. You would ‘probably 
have made many errors in just telling what happened and how it hap- 
pened. Your description as to what happened would be no more valid 
or reliable than your most inaccurate and inconsistent tool of observation. 
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Your theory as to how the effects came about would be based upon the 
correct and the incorrect observations of what effects occurred. In com- 
posing a theory of how the effects came about, you would be faced with 
the choice of a frame of reference from which you would draw your 
terminology. Would you choose to tell how the physiological effects 
occurred, the psychological effects, or draw upon some other frame of 
reference? If you chose only one point of view, you would not be reveal- 
ing the entirety of the situation. It would be improbable that you could 
cover all of the facts pertaining to what occurred and even less probable 
that you would be able to tell how each and every effect came about since 
you would not have complete knowledge of all the factors present. 

The best possible definition of a phenomenon would contain a descrip- 
tion of all the relevant factors and their relationship to the phenomenon. 
However, seldom is this high level of explanation required. Instead, 
explanation starts with description of data and increases through a 
hierarchy of description until there is enough information revealed to 
account for the occurrence of the phenomenon to be explained. The 
following example may help in the understanding of this hierarchy of 
explanation. 

You may think that some of your professors have completely explained 
a phenomenon for you, but it is probable that their explanations were far 
from complete. When faced with a question concerning the cause of a 
phenomenon, you attempt to relate to the questioner the events that 
immediately preceded the occurrence of the phenomenon and are appar- 
ently invariably related to the occurrence of the phenomenon. But the 
questioner might be insistent and push you farther with the question, 
“Yes, but why did the preceding events occur?" You then, in an 
attempt to further answer his question, relate the events that led up to 
the events that precipitated the event that became the subject of the 
question. You could go on this way ad infinitum and never find out just 
why the event in question occurred. However, in most explanations, it is 
seldom necessary to go much beyond a simple account of the facts that 
describe the setting in which the phenomenon occurred. If one wishes to 
go to higher levels of explanation then, according to Feigl (3), he may rise 
through the level of empirical laws where functional relationships are 
stated, or on to first-order theories where sets of assumptions using higher- 
order constructs as the result of abstraction and inference are involved, 
or on to second-order theories where still higher constructs are used. 
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CHAPTER 3 


ARMCHAIR EXPERIMENTATION 


This chapter represents an attempt to defend the procedure of scientific 
experimentation against the practice of “armchair experimentation.” 
By scientific experimentation is meant the actual work involved in 
directly dealing with the things about which one hypothesizes. Arm- 
chair experimentation refers to the habit of substituting reasoning alone 
for scientific experimentation in seeking the solution of a problem. It 
may seem that one is trying to knock down a “straw man” by arguing 
against armchair methods, but the beginning experimenter should know 
the reasons why he must “dirty his hands” to arrive at solutions to prob- 
lems rather than by relying on his “gluteal omniscience” for solutions. 

Armchair experimentation has been indulged in most heavily by philos- 
ophers whose knowledge of deduction has at times been outstanding. 
However, it is maintained here that deductive procedures without refer- 
ence, for validation purposes, to the event under discussion is logie with- 
out logic, 

Northrop (6, p. 19) points out that the philosopher makes no error when 
dealing with problems that merely involve deductions from true premises 
Such as found in mathematics. For here the basic premises have been 
Verified and preclude further verification. But the damage is done when 
the philosopher assumes certain premises to be true when they are not and 
then begins to build his card house on such false premises. There have 
been times when it would have been easy to check the basic premises but 
the philosopher either did not know how or did not want to take the time 
to verify his premises and deductions. Itis to this laxity in some philoso- 
phers that the scientist objects. 

The reasons armchair experimentation is dangerous are these. As indi- 
cated above, all deductive procedures begin with the acceptance of, 
usually, two premises as being true. If these two premises are true, then 
deductions can be made and eventually validated. However, if only 
Teasoning is used minus the personal contact of the reasoner with the 
material being reasoned about, then error may enter the process. Error 
may enter in at least three ways: (a) the reasoner assumes propositions or 
Premises which may or may not hold with the facts of the case, (b) the 
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deductive process consists of thinking as the medium of the manipulation 
of symbols and as such is susceptible to all the errors involved in thinking 
and in using symbols, and (c) the final answer or deduction cannot be 
validated until an appeal is made to the facts to see whether the deduction 
holds. Let us discuss these possible sources of error in some detail. 

A person who decides to reason his way through to the solution of a 
problem must have several things at hand. First, he must have a prob- 
lem that is capable of being answered. Second, he must have complete 
assurance that the information he will use as his basic premises is true in 
the particular context in which it is used. But can he assume such things 
unless he or someone else actually checks the basic assumptions in regard 
to their truthfulness? Certainly not. 

Instead of appealing to facts, the reasoner often appeals to other quar- 
ters. He may use one or more of three diverse and unprofitable methods 
which, while they are recognized by scientists as merely stumbling blocks 
on the road to knowledge, do plague all who attempt to arrive at facts. 


Method of Authority 


This method involves the statement that something is true because 
someone says it is true. The someone who says it is true is usually some 
well-known authority in his field and should know what is true. How- 
ever, this appeal to authority only assumes but does not ensure that the 
authority has sufficient evidence to make the statement that something is 
true. The average person depends on the authorities for much of his 
knowledge. Thus if the authority is in error, so are those who cite him 
as an authority. The great thinkers of the past have often chosen to be 
blind to fact and to follow some authority instead. Aristotle and Galen 
were considered to be irreproachable authorities for hundreds of years 
after their deaths. All that they had said was taken to be the absolute 
truth even when undeniable evidence was discovered that contradicted 
their views. In attempting to find fact, the method of authority must 
not be used blindly as a means of deciding the validity of suggested 
premises. The evidence back of thé authority’s statement must be 


known and accepted or the authority’s statement should not be accepted 
at all. 


Method of Tenacity 


This means believing somethin 
believed it. This method affect 


ARMCHAIR EXPERIMENTATION 27 


would have to be free from the influence of this method or he would always 
be susceptible to the errors cited. 


Method of Intuition 


This method deals with the tendency of some thinkers to make state- 
ments which they feel to be true propositions simply because the state- 
ments are “self-evident.” They feel that anyone who understands the 
proposition put forth must agree because the proposition is “undeniably 
and obviously true.” At one time it was thought self-evident that man 
would never fly to the moon. It is considerably less self-evident today. 
Intuitions, therefore, are not necessarily true but must be tested as any 
hypotheses. То allow these self-evident truths to serve as basic premises 
in a deductive procedure is to court error. Northrop (6), Cohen and 
Nagel (2), and Ruby (7) give additional information relating to these 
practices, 


Pseudo Science 

The assumption of certain propositions as true when it is possible to 
appeal to the facts is the unexcusable error made by armchair experi- 
mentation. As an example of pseudo science built upon false premises, 
let us look for a moment at phrenology and how it managed to thrive 
for a hundred years. 

Gall (1758-1828) was ап anatomist of some note. However, he allowed 
his early observations concerning bumps on the skull as related to mental 
characteristics in human beings to overcome any objectivity he might 
have possessed as a scientist. Не based his thinking on three untrue 
premises. First, he assumed that the mind of an individual is not 
unitary but is broken up into a number of faculties, each possessing or 
Controlling a particular function as demonstrated by the individual. 
Second, he assumed that the brain had various enlargements that influ- 
enced the conformation of the skull over the location of the enlargement. 
Third, he believed that the greater the possession of a trait, the greater 
the enlargement of the brain at the place where the particular trait was 
localized. Thus the logical conclusion would be that one could by study- 
ing the distribution and relative size of the protuberances on a person’s 
head make a valid assessment of his mental traits. But we now know 
that the mind does not consist of units, nor does the outer surface of the 
skull conform to the shape of the outer surface of the brain, nor do par- 
ticular faculties of the mind reside in different localized areas such that 
4n enlargement of an area is correlated with a greater possession of a given 
trait. Had Gall, by actual experimentation, utilized the process of 
Scientific investigation, he would have found no real basis for phrenology. 
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Boring (1, p. 50) points out, after a similar discussion of phrenology, that 
today we would have been able to reject phrenology by the use of correla- 
tion techniques. Although the mathematics of correlation were not 
available to Gall, Boring indicates that physiologists at that time could 
have made personal observations and checks and safeguards but that such 
rigors depended upon the investigator rather than the sanctions of science. 
Thus observation plus verification before generalization could have taken 
Gall out of the armchair class of experimentation and into that of scien- 
tific experimentation. It is interesting to note that had Gall been more 
rigorous, there would have been no pseudo science of phrenology, and, 
consequently, Gall would probably not have been remembered. 


Laws of Thought 


When one reasons, one thinks. The action of the thought processes 
involved may be described by several laws. Philosophers have for a long 
time denoted certain fundamental principles in reasoning and called them 
the laws of thought. Many philosophers in the past have held these laws 
to be logic itself and central to sound thinking. Whatever exceptions we 
can find to these laws we can offer as evidence against their use in the 
solution of problems by reasoning. If we can throw doubt on the validity 
of such “mental gymnastics” then we strengthen the position of experi- 
mental laboratory science as being a better approach to the discovery of 
facts. Let us take a look at these laws of thought. 

The Principle of Identity. If something is X itis X. This means a 
cow is a cow. You may agree, but wait! The main objection to this 
principle is not in its statement but in its frequent misapplication. You, 
as X, for instance, may be well today but ill tomorrow. Thus, X today 
is not X tomorrow. А cow at this instant is not the same cow it was an 
hour ago, for not only has the cow changed physiologically during that 
time, your attitude toward it has also changed. Thisis the position taken 
by Korzybski (4) and Hayakawa (3) and some of the other members of 2 
school of thought called general semantics. They would agree that since 
reasoning involves the assumption that there is a certain permanence of 
things, then the fact that all things are undergoing change at a faster or 
slower rate dilutes the validity of reasoning. 

However, those who believe in the law of identity, and contrary to the 
general semanticists’ attitude, point out that it is possible to communicate 
by words only because there is a certain identity in our meanings. Also 
they believe that even if there is a change, it must be in relation to some- 
thing that is constant, and this constancy is the meaning with which we 
deal. They would say, then, that the symbols used in reasoning are valid 
building blocks. 
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In order to make use of this law of thought properly, one must always 
give a time and place reference. An objection to this law then would be 
that too often such specific designations are omitted through a lack of 
knowledge, or carelessness, and thus may throw error into an otherwise 
logical progression of thought. If one reports that it is a clear day, he 
must be specific, for it may be raining only a hundred miles away. If one 
were to say it is a clear day in the city of Pittsburgh (unhappy choice) on 
April 1, 1952, at 12 noon, he would be specifying the time and place in 
such a way as would make his statement true for all time and place. In 
describing happenings, stating laws, or in any type of communication or 
reasoning, it becomes essential that a complete statement involving con- 
text is given so that the law of identity may apply. 

The Principle of Contradiction. A thing cannot be both X and not X. 
For example, а man cannot be both tall and short at the same time. 
Those who object to this principle would do so by pointing out in the 
above example that a 5-foot man would be short in some tribes in Africa 
where the average height of males is considerably more, but the same 
5-foot man would be considered tall by a band of pygmies. In a like 
manner, a certain table seen from directly above appears square (X) but 
when seen from one side appears rectangular (not X). 

The objection to this law of thought is removed if the user again sup- 
plies a frame of reference involving time and place reference. "Thus, the 
5-foot man in a tribe where the average height is 514 feet will always be 
Considered short as long as he remains in that particular frame of refer- 
ence. The only remaining objection is whether in a complicated problem 
Composed of many variables, it is probable that all such designations 
could be handled accurately. 

The Principle of Excluded Middle. Anything must be either X or not 
X. For example, this is either a book or not a book. 

To many persons, this is the most objectionable of the three principles. 
These critics would say that nowhere in nature do you find that things are 
either one way or another with a gap in between. One simply finds no 
dichotomies or mutually exclusive classes in nature. There is always the 
area of overlap. You may think that black and white are completely 
different, but you cannot find that nature has drawn a line between black 
and white. Instead of a point of demarcation, one finds a shading of 
black into white through the middle area of gray. How can you draw a 
line separating the two? You may think coal is black, but it becomes 
gray by comparison when held against a piece of black velvet. For the 
thinker arbitrarily to put the continuous order of nature into pigeonholes 
by excluding the middle is to cast aside much of his contact with things 
35 they really exist. Many of the great problems argued in philosophy 
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have come about only because of the acceptance of this law of thought. 
Instead of a two-valued orientation consisting of either-or they would 
suggest a multivalued orientation. MM 

Ruby (7, p. 258) points out that the error made by some in criticising 
this principle is based upon the confusion between contrariety and con- 
tradiction. The law says that a book is either red or not red, it does not 
say that it is either red or reddish brown. 

These laws are tools we all must use in our thinking. However, fewer 
errors will be made in their application if certain precautions are taken: 
(a) always designate time and place reference, and (b) remember that man 
has in many cases imposed artificial categories on nature and as such has 
introduced an error in drawing lines where they do not actually exist. 
For a more complete treatment of the laws of thought, the reader should 
consult Ruby (7) and Cohen and Nagel (2). 


Errors in Using Symbols 


The most common source of error is made when the thinker assigns 
symbols to the elements of the problem with which he is dealing. Thus 
he begins to use, perhaps, the letters A, B, and C as designations for the 
variables or factors. These letters are now used by him in his thinking 
as though each is defined by the characteristics of the factor for which it 
stands. But this cannot be true, for he does not know all about the 
characteristics of A, or B, or C. If he did, it would not be necessary for 
him to go through his reasoning process, for there would be no problem. 
Thus if he continues to use the symbols in the absence of the things for 
which they stand and continues to build inference after inference on such 
a structure, he may, and most often does, get farther from reality and 
finds in the end that he has been dealing only with words and not things. 
If he would, at each step in his thinking, check his logical result by 
referring to the real situation again, then he might safely proceed. He 
would find that symbols are more static than the things they represent 
and that due to the stability of symbols and the variability of the things 
for which they stand, his result from reasoning might differ grossly from 
his results by experimentation, 

An example might help here. 
radio. He carefully calculated the exact value each condenser, resistor, 
and other parts should have. On paper, it was perfect. But when he 
constructed the radio from the diagram, the radio refused to play. The 
vas that he had assumed the parts corre- 
used in the diagram. Yet + i 
were not perfect and only approximated the characterist; 


) ies they were 
supposed to have. 'The combined errors of all these sm 


all differences 
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added up to an error so large that the radio needed much adjustment 
before it finally operated efficiently. 

Any word may have many meanings, one of which may be applicable to 
the particular thing for which it stands at a precise moment. But the 
thing denoted is constantly changing in its relationship to other things 
and thus may require a different word if we are to keep track of it a 
moment later. Treating words, then, as accurate substitutes for things 
is dangerous to sound thinking if one does not constantly keep in touch 
with the reality of the situation. The point is this, a symbol is only 
analogous to the thing for which it stands. For a more complete dis- 
cussion of semantics, see Larrabee (5). 

If one wishes to deal with facts, he must restrict himself to dealing with 
Whatever experiences he may have as the result of observing facts 
directly. If he attempts to communicate these experiences to others, 
neither he nor they are dealing with facts—they are now dealing with 
described facts. And description, as has been pointed out, is full of error. 

We see, therefore, the dangers involved in attempting to solve problems 
by the use of symbols rather than directly dealing with the elements of the 
problem. Real advances were never made in science until man left his 
armchair and entered the laboratory. Going into the laboratory does 
not mean the scientist leaves logic and reason behind. Scientific methods 
are based on logie. The reader should have the impression that logical 
progression of thought concerning a problem is useful only in that it may 
lead to testable hypotheses which can be accepted or rejected in light of 


experimental data. This is the safest way to build a sound science. 
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CHAPTER 4 


LOCATING AND SIMPLIFYING PROBLEMS 


Every individual is constantly faced with problems. Most of his prob- 
lems are at a simple object level and involve no more than the manipula- 
tion of certain things in his environment to produce desired results. An 
individual is faced with a problem if in attempting to put on his coat his 
wrist watch catches in the lining of the sleeve. The problem is how to 
disengage the watch from the cloth of the coat. This is a very simple 
example, but it is of the class of problems everyone encounters constantly. 
More serious problems exist in everyday life when we find that we are 
running out of money and yet must pay certain bills that add up to more 
than our bank account. A more demanding problem and one bringing in 
more psychological involvement is the problem of how to get and stay 
married and yet continue with our education. 

In each of these examples, from the simple object type to the type 
involving psychological concomitants, there is one common factor, 
namely, a problem is a question proposed for solution. Generally speak- 
ing, a problem exists when there is no available answer to some question. 


Finding a Problem 


Where are problems found that are worthy of investigation by experi- 
mentation? Sometimes problems in psychology are given to the experi- 
menter by someone else, as when the laboratory instructor informs the 
class that the problem for today’s experiment will be this or that. The 
student is relieved of the burden of finding a problem in this situation. 
The instructor is, too, for the most part, because he will probably suggest 
a problem that has already been formulated back in the history of 
psychology, already has been answered, and is nearly worn out by being 
used before in countless thousands of such laboratory situations. In this 
situation, the student may never have the experience of discovering for 
himself a question in psychology that would serve as a problem. 

As the student progresses under such a setup, he may find that even 
while hemmed in by the limits of traditional problems and prefabricated 
experiments he may run into an honest-to-goodness problem. 16 might 
happen in this manner. During the performance of a typical laboratory 
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maze learning experiment using the class as subjects, the student might 
suddenly think, what would the results of this experiment be if rats were 
used instead of human beings? What if in doing the experiment using 
rats as subjects, I discovered a difference in results? To what could I 
attribute the difference? These questions in the student’s mind have, 
besides demonstrating that the student is thinking about his experiment, 
caused the formation of the basis for a new problem in psychological 
research. The student has perhaps for the first time in his life formulated 
а problem in the area of psychological experimentation. 

The instructor, when asked about the plausibility of such an experi- 
ment, might say, “Oh, that has been done, and it has been found that 
sometimes rats can solve mazes better than college sophomores.” The 
student is not encouraged. 

But suppose the instructor says instead, ‘‘Why don’t you design an 
experiment to investigate this problem and I'll see if we can put it to a 
test." Let us suppose the student does design the experiment, conducts 
the experiment, and finds a large difference between his rats and human 
beings as to maze learning ability, the difference being in favor of the 
rats. The student may then ask what caused this. In attempting to 
answer this problem, he is certain to create many other problems. For 
instance, is the rat superior to the human being only when adult rats are 
used, only when extreme motivation of the rat is used, only when visual 
cues are excluded, etc.? 

The student in the above example can now tell you where problems for 
research originate and how to recognize them. І He now knows that he 
сап recognize problems in any area only when he is thoroughly acquainted 
with that area. Не will further tell you that the quickest way to be 
acutely aware of problems existing in a given area of science is to become 
familiar with the area to the point where it is possible to see the informa- 
tion that is needed to progress further and that it is totally or partially 
lacking. 

Problems in the science of psychology range over a vast amount of 
human knowledge. It might be said that any problem in any of the 
Sciences involves a problem in psychology. Is it not true that if any 
Scientist is making an observation, his own psychology enters into his 
perception? АП рһепотепа appeal опу to the experience of the observer. 
These “sense data” are then molded into whatever shape the psychology 


of the observer dictates. This puts the psychologist right in the middle 


of all science, or anywhere sense data are collected. | 
See Northrop (4), Benjamin (2), and Cohen and Nagel (3) for dis- 


cussions related to the location of problems. - | 
But more specifically, just what аге typical and legitimate areas for 
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psychological investigation and just what are the problems dealt with 
within these areas? The easiest place to look for such information would 
be the tables of contents of the Psychological Abstracts, or the tables of 
contents of experimental psychology texts by such authors or editors 
as Andrews (1), Stevens (5), and Woodworth (6). By analyzing the 
contents of these sources, one would find psychology to be arbitrarily 
divided into 14 major divisions. The following outline of such an analy- 
sis will aid the student in categorizing and defining the problem areas of 
psychology. 


Animal behavior 

Childhood and adolescence 

Electrical activity 

Experimental esthetics 

General (test construction, statistics, theory, systems, new method- 
ology, apparatus, other) 

Intelligence and other aptitudes 

Learning 

Maturity and old age 

Personality (including diagnosis and treatment) 

Personnel selection and placement 

Reading, work habits, and study skills 

Receptive processes (example—vision) 

Response processes (example—feelings) 

Social interaction 


As can be seen, the psychological researcher has considerable latitude 
in the choice of a problem for research. 

It is not enough, however, just to discover problems and proceed to 
attempt to answer them by experimentation. Most of the problems that 
the beginner thinks he has formulated himself for the first time in history 
have already been not only formulated previously but perhaps exhaus- 
tively studied in the laboratories of the science and acceptably answered. 
Knowing the field of psychology also means knowing its history. By 
history is meant not only the names and dates of the happenings of 
psychology, but also the results of experimentation by past researchers 
on the problems that have faced psychologists. 

The first step in evaluating a problem, therefore, is to seek information 
concerning the history of your problem. Go to standard text and refer- 
ence books that discuss the area in which your problem rests. Often 


their bibliographies will direct you to more pertinent information to be 
found in the journals. 
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| The more accessible journals of psychology and related sciences аге 
listed below for the purpose of giving the student a quick glance at the 


scope of the journal literature of his and related fields. 


The asterisks 


preceding certain titles indicate those journals most often used as refer- 


ences by the author. 


American Journal of Physiology 
*American Journal of Psychology 
“American Journal of Psychotherapy 
* American Psychologist 
* Archives of Psychology 

Brain 

Child Development 

Child Development and Bibliography 

Child Development Monographs 

Child Study 

Child Welfare 
“Comparative Psychology Monographs 

Crippled Child 

Diseases of the Nervous System 

Endocrinology i 
"Genetic Psychology Monographs 

Genetics 
*Group Psychotherapy 

Hereditas Genetiskt Arkiv 

Heredity 

Human Relations 

Industrial Arts and Vocational Educa- 

tion 

Institute of International Education 

Bulletin 
International Index to Periodicals 
International Journal of Opinion and 
Altitude Research 
a ournal Lancet 
Journal of Abnormal 
Psychology 

Journal of Adult Education 

Journal of Aesthetics and Art Criticism 

Journal of Animal Behavior 

Journal of Animal Science 

Journal of Applied Anthropology 
ЕК ошта! of Applied Physiology 

Journal of Applied Psychology 

Journal of Aviation Medicine 

Journal of Clinical Endocrinology 


and Social 


Journal of Clinical Investigation 
*Journal of Clinical Psychology 
*Journal of Clinical Psychopathology 
and Psychotherapy 

*Journal of Comparative and Physio- 
logical Psychology 

*Journal of Consulting Psychology 

Journal of Criminal Science 

Journal of Cutaneous Diseases Includ- 

ing Syphilis 

Journal of Ecology 

Journal of Education 
Journal of Educational Psychology 

Journal of Educational Research 
Journal of Educational Sociology 
Journal of Experimental Biology 
Journal of Exceptional Children 
Journal of Experimental Education 

Journal of Experimental Medicine 
Journal of Experimental Psychology 

Journal of Experimental Zoology 
Journal of General Education 

Journal of General Physiology 
*Journal of General Psychology 
*Journal of Genetic Psychology 

Journal of Genetics 

Journal of Heredity 

Journal of Higher Education 

Journal of Juvenile Research 

Journal of Laboratory and Clinical 

Medicine 

Journal of Medical Research 

Journal of Neurophysiology 

Journal of Nervous and 

Diseases 

Journal of Organotherapy 

Journal of Parapsychology 

Journal of Pediatrics 
*Journal of Personality 

Journal of Personnel Research 


Mental 
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Journal of Philosophical Studies 

Journal of Philosophy 

Journal of Physiology 

Journal of Psychiatric Social Work 

*Journal of Psychology 
Journal of Social Casework 
*Journal of Social Psychology 

Journal of Speech and Hearing Dis- 
orders 

Menninger Clinic, Bulletin 

Mental Hygiene 

Mind 

Mind and Body 

National Society for the Study of 
Education, Yearbook 

Occupational Index 

Occupational Medicine 

Occupations 

Pedagogical Seminary and Journal of 
Genetic Psychology 

Pediatrics 


Personnel Journal 

Personnel Psychology 

Philosophy of Science 

Prison Journal 

Progressive Education 

Psychiatry 

Psychoanalysis and the Social Sciences 
Psychoanalytic Quarterly 
Psychoanalytic Review 
*Psychological Abstracts 
*Psychological Bulletin 

Psychological Clinic; A Journal of 

Orthogenics 
*Psychological Monographs: General and 
Applied 

*Psychological Review 

Psychosomatic Medicine 

Public Opinion 

Social Science Abstracts 

Sociology and Social Research 
Sociometry 


Personnel 


Most university libraries subscribe to most of these journals. Journals 
desired by a student, but not available in his university’s library, may be 
secured through the interlibrary loan service. 

Occasionally, reference is made in bibliographies to unpublished theses. 
These, too, may be secured, through the interlibrary loan service, by hav- 
ing your university’s librarian request the theses from the universities 
where they were submitted. Several copies of all theses, published or not, 
should be on file at the institution where the research was completed and 
accepted. 

Every good researcher recognizes the library as being a close friend. 
He should know his local library thoroughly. He should know where in 
the stacks the literature relevant to his field is shelved, the procedure for 
securing journals, theses, and books through interlibrary loan, limitations 
and privileges in reference to photostating and microfilming facilities, 
film service, etc. 

The Psychological Abstracts and, for experiments published before 1927, 
the Psychological Index will aid a student in quickly evaluating an article 
before going to the trouble of seeking out the journal containing the 
article in its original, complete form. Those journal articles most 
relevant to research should be sought out and read and discussed with 
someone else interested in the same problem. Two heads are certainly 
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better than one in this case. What a student misses and confuses, a 
coresearcher or other interested party may know, and vice versa. 

If a student reads a relevant article in a journal and would like to have 
a copy of the article, not the journal, he may write to the author and 
request a reprint of the article. In case of coauthorship, he should write 
the first-named author. The following information should be included 
in the request: name of authors, name of article, the name, volume, date, 
number, and pages of the journal. The author will send the offprints free 
of charge as a matter of professional courtesy. The success of this pro- 
cedure for securing offprints depends on how current the literature is and 
whether the author has any reprints left. 

Manipulate the information given by the articles as much as possible 
by turning it over and over in your mind and verbalizing it in all possible 
lights. If you, yourself, write abstracts of the articles on filing cards, 
а valuable collection of information is soon gathered in one place. Such 
a historical survey is not only an efficient means of arriving at a clear-cut 
problem truly existing but it is indispensable to a sound foundation for 
the proposed research. A convenient form for abstracting articles is 
shown below. The headings may be typed or mimeographed on 8- by 10- 
inch filing cards. 


Form for Abstracting Journal Articles 


Reference: __ 
Authors’ Names Abstractor 
Е m E Date 
Title of Article 
US of Journal Date Volume Pages 
Problem; 
Subjects; 
Procedure: 


Results and Conclusions: 


In the preceding chapters, an attempt has been made to arm the begin- 
ning researcher with those concepts of thinking necessary to evaluate the 
Way in which facts сап be gathered. If the presentation is correct to this 
Point, then we see that the end product of thinking about a problem and 
attempting to arrive at its answer rests in the act of performing and 
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evaluating an experiment aimed at testing certain suggested answers to 
the problem. This procedure is the experimental method, only one of the 
scientific methods. Later on in this book the method of naturalistic 
observation and the statistical method will be briefly discussed. 


Analysis of the Problem 


The application of the experimental method starts at the point where 
any inquiry starts, that is, with the problem itself. It is only through a 
process of analyzing the problem with which he is faced that the researcher 
may choose the method with which he will deal with the problem. There 
are many who believe that the experimental method is the only method 
safe to use in the search for fact. However, Northrop (4, p. 20) points 
out that the problem decides the method. Often only the methods of 
formal logic are needed, as in mathematical deductions. Sometimes a 
problem such as might be found in the field of ethics is of such a nature as 
to demand a new method. The experimental method might not suffice, 
for some questions in ethics are not answerable by the search for empirical 
truth. For example, the experimental method does not necessarily apply 
when one secks the answer to “ought” questions. New methods must be 
devised to discover what ought to happen, as in the case of “What ought 
the world do about the atomic bomb?” On the other hand, the experi- 
mental method applies when one wishes to answer the question, “ What 
ishappening?” Since sucha distinction exists there are many who would 
exclude the word ought from the scientist’s vocabulary, and say that 
“what is the case” is a better substitute. Thus these researchers would 
limit the area of scientific research to those problems wherein the experi- 
mental methods (or the empirical methods of observation and experiment) 
are applicable. 

The analysis of the problem takes, or at least it should take, as much 
time as all the rest of the thinking concerning the research project. The 
problem is the first link in the chain of thoughts necessary for the success- 
ful planning of an experiment. After the precise problem has been 
decided upon, the other steps of the experimental method should follow in 
a standard order. Below is an outline of the steps the researcher goes 
through in his thinking and acting as he develops a design for his research. 


Steps in Developing a Research Design 


1. What is my problem? 

2. What is my hypothesis? 

3. What is my independent variable(s)? (Defined in Chap. 6) 
4, What is my dependent variable(s)? (Defined in Chap. 6) 
5. How is the dependent variable to be measured? 
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6. What controls are necessary? 
7. What procedure will be followed in conducting the experiment? 
a. What apparatus will I need? 
b. How, exactly, and in what sequence, do I plan to conduct the 
actual experiment? 
c. How will I analyze the results? 
8. Will I be able to use the results of this experiment to prove or dis- 
prove my hypothesis? Have I made any mistakes? 


These eight steps are commonly called the research design, and are com- 
pletely thought through before the experimenter steps into his laboratory 
for the purpose of conducting his experiment. Each of these steps is dis- 
cussed at some length later on in this book. Several of the steps will 
serve as the subject matter for separate chapters. Let us now return to 
the first step, the problem and its analysis. 

After the history of the general problem has been completely learned, 
you are ready to make the problem more specific. History may have 
given you information in regard to the best type of apparatus to use, the 
best type and number of subjects, the least involved method of approach, 
variables relevant to the problem which may have to be included or 
excluded, the most efficient statistical tools, the least expensive procedure, 
the length of time estimated for the collection of data, common mistakes 
easy to make, correct interpretations of this type of data, criticisms of 
others’ experiment in that area, and much more. All this information, 
cheaply gathered, allows you to select the precise statement of the prob- 
lem you had only stated generally before. Little by little the problem 
should have reduced itself to a more meaningful question. 

Take this example of the evolution of a problem from a general form to 
a clear, objective, concise question: a teacher of psychology in college 
noticed that certain students appeared less at ease than others, and yet 
the most stable were often only average in learning new things. The 
psychologist thought of this question: 

1. Could it be that average learners are less nervous because they are 
average? 

Then he thought to himsel 
having average intelligence.” 


f, “Ву average learners, I really mean those 
This yielded the following question: 

2. Are students with average intelligence less nervous than others? 
“But by nervous," he said to himself, “I mean that they have certain 
signs of abnormal or unusual psychological behavior.” 

3. Do students possessing average intelligence have fewer symptoms 
of abnormal behavior than those having very high or very low intelligence? 

“But with which intelligence group am I going to compare those having 
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normal intelligence? Suppose I take just those students who have LO 
between 90 and 110 and compare them, with respect to symptoms of 
abnormality, to students having I.Q.’s above 120. ТЇЇ do another study 
later in which I will compare the amount of unfavorable psychological 
symptoms present in a group having I.Q.’s below 80 to a group of indi- 
viduals having 1.Q.’s between 90 and 110." 

4, Will students having I.Q.’s between 90 and 110 have fewer signs of 
unfavorable psychological symptoms than students having I.Q.'s above 
120? 

“Of course," says the psychologist, *you can't use any old test for 
1.0. and get reliable results, so I had better phrase my question again. 
Also I had better include the name of the test I am going to use to measure 
unfavorable psychological signs." 

5. Will students having total I.Q. scores on the Wechsler Bellevue 
Adult Intelligence Scale within the range of 90-110 have lower percentile 
scores on the Minnesota Multiphasic Personality Inventory than students 
having total I.Q. scores in excess of 120? 

And in final form: 

6. Will college students at State University who have total I.Q. scores 
on the Wechsler-Bellevue Adult Intelligence Scale within the range 90-110 
have lower percentile ranks on the subscores of the Minnesota Multi- 
phasie Personality Inventory than a like group of students having total 
1.Q. scores in excess of 120? 

In a similar manner most problems can be reduced to a specific meas- 
ureable form. As can be seen, considerable information was provided by 
the psychologist in the reduction of his observation to the form of a ques- 
tion. With sufficient practice, the experimenter can quickly go from an 
observation that a problem exists to a statement containing the impor- 
tant elements of the situation. 

In the above example, the original ideas concerning the problem 
changed from a vague impression that a. problem existed to a complete 
statement of the problem in terms of a set of operations. This is the cor- 
rect procedure for the initial stage of inquiry, i.e., the problem. How- 
ever, it is sometimes necessary to go past the surface problem and on to & 
basic problem or problems whose answer would unequivocally answer the 
existing problem by testing the assumptions which gaverisetoit. Some- 
times through such an analytie approach to a problem, it is found that an 
experiment is eventually performed not on the problem that first occurred 
but upon a basie problem obvious only after the phenomenon has been 
reduced to its simplest form by the process of analysis (4, p. 98), 

A mother, with severe tooth decay, once made the remark to the author, 
“Tf a woman wants to have good teeth, she should not have children.” 
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Put in problem form this statement becomes: Is the bearing of children 
significantly related to the incidence of tooth decay in women? If an 
experiment were performed, it is probable that, on the basis of the data 
collected, the answer would be yes. However, the problem is analyzed 
further, it is discovered that it is not the bearing of children that is proba- 
bly related to the incidence of tooth decay but the amount of calcium 
present in the mother’s body. The assumption back of the woman’s 
question really dealt with calcium deficiency and not childbirth. There- 
fore the writer asked the woman, “Did you supplement your diet during 
pregnancy by adding calcium?” She replied in the negative, and 
admitted she had made a doubtful statement. 

Thus both childbirth and calcium deficiency are related to the incidence 
of tooth decay in mothers, but under analysis we discover that tooth 
decay is more probable in calcium-deficient mothers than in calcium- 
sufficient mothers during pregnancy. We then decide that the problem 
deals with calcium deficiency and not childbirth. Our analysis of the 
problematic situation has led us nearer the truth. 

In the earlier discussion concerning phrenology, it was noted that two 
different levels of experiment could have been performed. The first, to 
answer the problem, “Сап the protuberances on the skull be used as a 
valid means of diagnosing personality? ? This problem could be answered 
by a simple correlational study. The second, to answer the problem, 
“What is the reason or reasons phrenology is not valid as a means of 
diagnosing personality?” This problem could be answered by putting 
to a test the basic assumptions upon which phrenology was built. Once 
these assumptions are invalidated, it has not shown that phrenology does 
not work, but only that if phrenology does work, it must depend upon 
other assumptions for its support. The reason it works or does not work 
would never be found by observing the practice of phrenology and gather- 
ing data on its validity. Only additional proof that it works or does not 
Work would be found. Later on it will be shown that problems may exist 
at two levels: (a) factorially, or the “what happens” type, and (b) fune- 
tionally, or the “how it happens” type. The functional-type experiment 
is the one that offers explanations for phenomena, but this type can only 
be performed after the problem has been analyzed to the point where its 
basic assumptions can be tested. : . . 

Many, if not most, of the great discoveries of Science came about 
through accidents. Of course, the word accident is hardly applicable 
here, for it was no accident that the experimenter was in his laboratory 
Working in a particular area and observing when the phenomenon 
Occurred. But what is meant by this is that the experimenter was not 
investigating a particular problem or seeking a particular result when it 
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occurred. Often such happenings are overlooked by all but the genius. 
However, a rule that will allow the experimenter to capitalize on such an 
accident is: To observe, record, and investigate all unusual, unplanned, 
and nonconforming happenings in the laboratory. It may be that the 
happening that was unplanned and as yet unexplained is a signpost point- 
ing toward a new discovery. The conditioned reflex was discovered in 
just this manner. 

Because of the scope of psychology, the experimentalist of today finds 
he is unable to keep abreast of all that is going on. Therefore, either he 
is satisfied with only a shallow knowledge of all areas of research or he 
faces the only alternative—specialization. Good researchers usually 
have made the second choice. 

In certain areas, the researcher finds that from necessity he is forced to 
make use of the lower animals as subjects. Not only are the lower ani- 
mals, the rat for instance, more available as subjects but they can be used 
in ways human beings cannot be used. But mainly the use of lower 
animals is desired because they behave in a more simplified manner than 
the human being. Basic processes can be studied in the lower animals 
without the distracting influence of a culture entering into the experiment. 
Thus it is seen that the problem may be simplified if it is sought where it 
exists in its simplest form. 
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PART B 
DESIGN AND CONDUCT OF EXPERIMENTS 


CHAPTER 5 


FORMATION OF HYPOTHESES 


An event occurs and you observeit. If you know very little concerning 
the area of knowledge within which the phenomenon exists, you may be 
able only in a general way to speculate about the cause of the event or its 
relationship to other relevant factors. 

After basic speculations, which are only scattered thoughts about a 
problem and an occasional guess as to the cause of the phenomenon or its 
relationship to other factors relevant to it, you may seize upon one or 
more possible answers to the problem. But until these answers are put 
to an experimental test, that is, until an experiment is performed to test 
the possibility and establish the probability of the answer or answers, 
your hypothesis is still only a hunch. 

Bacon and others of his ilk believed that hypotheses should be sug- 
gested as soon as the existence of a problem is discovered. It is true that 
One usually does this, but one does not then immediately follow with an 
experiment to test each of these hurriedly produced hypotheses. Instead, 
hypotheses should come along after one has completely analyzed the 
problem. The problem’s the thing wherein one catches the reflection of 
hypotheses doomed to failure as the result of evaluation by experimenta- 
tion. When the problem is completely analyzed and carefully defined, 
then the hypothesis, or hypotheses, becomes obvious, and occurs in 
the right place as the second step in the development of the research 


esign. 


Definition of Hypothesis 

A hypothesis is defined as a suggested answer to a problem. But the 
acceptable hypothesis must be a suggested answer that meets certain 
Important requirements (2, p. 207, 3, P- 197). : 

1. A hypothesis must be an adequate answer to the specific problem that 
demanded an answer, In other words, the hypothesis must fit the prob- 
lem so as to provide one answer to the one problem stated. It is possible 
to have several hypotheses that may answer one problem, but each of 
these hypotheses must suggest an answer from a different point of view. 
Any one hypothesis must be clear-cut in its meaning and not contain 
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more than one possible answer. Compound, and thus complicated, 
hypotheses dealing with more than one suggested answer at one time yield 
complicated experiments and a resulting difficulty of interpretation. 

2. A hypothesis must be the simplest answer to the problem. Hypotheses 
that are not clearly stated by containing only the essential elements of 
solution are inexcusable and troublesome. Since the experiment to fol- 
low your hypothesis is designed from the elements of the hypothesis, the 
simpler the hypothesis, the simpler is the experiment to test its validity. 

3. A hypothesis must be verifiable. 1f the hypothesis is stated in such a 
way as to prohibit the testing of its value, it is worthless. Hypotheses 
such as “All men are mortal” cannot be tested because it would be neces- 
sary to wait for the death of all men to validate the hypothesis con- 
clusively. However, hypotheses do not need to be directly testable. It 
is not necessary that the problem situation be one capable of being brought 
into the laboratory and manipulated. Astronomers have for centuries 
formed and tested good hypotheses concerning the planets in remote 
space. But their hypotheses were well formed and in line with the condi- 
tion of a possibility of verification. 

4. A hypothesis must be stated in such a way as to allow it to be refuted. 
If a hypothesis is stated in a manner allowing it to be proved by an 
experiment but not disproved, it loses the right to be called a good 
hypothesis. Тһе hypothesis that men fight because they have aggressive 
instincts is not capable of being refuted. In every instance where fighting 
occurs, the presence of the aggressive instinct could be claimed, but the 
absence of the behavior in some men would not disprove the presence of a 
latent instinct. 

In the development of a good hypothesis the student must observe 
the above rules. Forming acceptable hypotheses is not difficult if the 
problem giving rise to the hypothesis has been carefully stated and 
defined. "The form of a hypothesis is that of a declarative statement con- 
taining a suggested answer to the problem, and which obeys the formal 
conditions of hypotheses. Following are two problems and their respec- 
tive hypotheses. 

Рвовцм 1. Does practice with the preferred hand improve the 
proficiency of the nonpreferred hand in the mirror drawing experiment? 

Нүротнкѕіѕз. Practice with the preferred hand significantly improves 
the proficiency of the nonpreferred hand in the mirror drawing experiment. 

PnomnLEM 2. Ате male rats more active than the same strain of female 
rats during a 6-day period spent in an activity cage? 

Нүротнкѕіѕ. Male rats are not significantly more active than the 
same strain of female rats during a 6-day period spent in an activity 
cage. 
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Definition of Null Hypothesis 


We can see from the two examples given above that in the first case the 
hypothesis was stated affirmatively and in the second case negatively. 
Hypotheses that will be tested by experiments with the results finally 
evaluated statistically аге in their best form if stated negatively. Stating 
the hypothesis negatively may help to reduce the bias of an experimenter 
who is ego-involved in his attempt to prove his hypothesis. When a 
hypothesis is so stated it is called a null hypothesis. The word null 
means zero in German. Null hypotheses are, therefore, zero hypotheses. 
Let us see what is meant by that. 

Let us take the null hypothesis which follows as an example. The 
average intelligence of a large group of men is not significantly different 
from the average intelligence of a large group of women. Suppose you 
then conducted an experiment to test this statement and discovered that 
a difference in the two averages actually did exist. However, you noticed 
in your data that some of the women were better than some of the men, 
but that the average for the men was а little above the average for the 
Women. You might then be in doubt as to whether you had conclusively 
disproved your hypothesis, particularly since the averages were close 
together. In stating your hypothesis as a null hypothesis, you said in 
effect that no difference exists between men and women in respect to 
intelligence. Implicit in this statement is the idea that no difference 
exists between the scores of men and women in respect to intelligence 
other than what could be due to chance fluctuation alone. 16 is obvious that 
the averages you calculated were not necessarily correct and the chances 
are if you conducted the experiment again you would get at least slightly 


different averages than you did the first time. Now, due to a number of 
uncontrolled factors whose influence we call chance there would be many 
In fact, even if it were absolutely 


Possible averages you could secure. игече І 1 
true that men and women do not differ one iota in intelligence, you might, 


In securing averages of the intelligences of men and women, find that some 
differences were indicated by your experimental results. Such a differ- 
€nce would not, in this case, indicate that a difference in intelligence 
existed but only that through some chance factor, such as inaccuracy of 
your measuring instrument, your results indicated a difference while the 


true difference was zero. 
а Тһе greater ће difference between 
it is that the true difference is zero. 


the two averages, the less probable 
Jf it were possible to calculate just 

ow large a difference might be due to chance even if the true difference 
Were zero, then it would be known when the averages were so close 
together that the difference might be due to chance entirely. Likewise, 
1f the experimenter could calculate in any experiment, wherein his results 
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are in the form of two averages, whether his averages are too far apart for 
the difference to be easily accounted for in terms of chance fluctuation, 
then he would have an excellent way of deciding whether to accept the 
null hypothesis or not. The experimenter can, fortunately, do this as 
will be shown in the chapter on statistical techniques. 

If the experimenter finds that the difference between his averages is 
so small that it might easily be due only to chance, then he may accept the 
null hypothesis and say that a true difference does not exist. If the differ- 
ence between his averages is so large that it is only remotely probable that 
it is due to chance, then he may reject his null hypothesis and say that a 
true difference does exist. 

The experimenter who uses the null hypothesis form provides himself 
with the opportunity to accept or reject his hypothesis in terms of the 
probability that the difference between his groups is due to chance alone. 
In the chapters on statistical techniques the reader will find additional 
advantages to be gained from using the null hypothesis. 

One other point is especially important. The acceptance or rejection 
of a null hypothesis is no assurance that the alternative hypothesis can be 
accepted as true. It may very well be that the experiment was not an 
adequate test of the hypothesis and thus an error was made in accepting 
or rejecting it on the basis of such evidence. 


Origin of Hypotheses 


Hypotheses, in their broadest sense, offer more than mere declarative 
statements suggesting an answer to a problem. As a problem is reduced 
from its original unclear and ambiguous form to a specific question 
phrased in terms of a set of operations, the formation of hypotheses is 
already taking place. Ву the time the problem is reduced to an accepta- 
ble form and meaning it could easily be converted into a hypothesis by 
making the question into a declarative statement. In the process of 
simplification of the problem, then, somewhere along the line, the hypoth- 
esis was formed. Just where did this formation take place? Let us take 
a problem and see when the hypothesis first appears. 

Suppose you are a clinical psychologist and have just met your patient. 
She is a twenty-year-old girl who was "promoted" on age through school 
to the ninth grade, can hardly read even simple material, has difficulty in 
pronouncing her words, and has a mother who finally came to the con- 
clusion that she should seek help for her daughter. Your problems in 
this situation are three in number. The first, what is wrong with the 
girl? The second, how did it come about? The third, what can be done 
about it? Whatever action you now take to answer any of these problems 15 
a hypothesis. Suppose you decide to administer an intelligence test to 
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the girl. You are suggesting by that act that the girl's difficulty is related 
to her intelligence. You will, on the basis of the evidence provided by the 
results of the test, accept or reject the hypothesis that her intellectual 
status is a sufficient and necessary cause for her behavior. Suppose you 
find that the girl’s I.Q. meets the mental deficiency classification. You 
have answered problem one, at least in part. Problem two now faces 
you. How did the mental deficiency come about? You now look closely 
at the girl and notice that one of her front teeth is directly on the mid-line, 
the left side of her face is slightly deformed, and there is a depression on 
the left side of her head over the temporal lobe. Your hypothesis was 
made the moment you started looking for organic brain damage. What 
you now see only confirms the hypothesis you had in mind as soon as you 
learned that the patient was mentally deficient. You ask the mother at 
what age the patient first walked and talked, when the mother first 
noticed the patient to be “different” from other children, and if the child 
had been an instrument baby? Yes, the child had been an instrument 
baby, and it’s head had been severely damaged by the forceps, the child 
Was late to talk, late to walk, and from very early in childhood had 
appeared to be “different.” Further examination by a physician indi- 
cated definite brain damage of long standing. Problem two is solved. 
Problem three, what can be done about it, is quickly solved. You тесот- 
mend that the patient be placed іп a special school where she will be 
trained for a vocation with which she can cope. Your hypothesis 
appeared as soon as you suggested a special school. Past experience 
forced you to hypothesize that the condition is permanent, formal school- 
ing of no use, and that specialized vocational training for a routine job is 
as much as could be done. . 
Now let us summarize. When did the hypotheses appear, where did 
they come from, and what use did they serve? | . 
Hypotheses first appear when a definite set toward solving a problem is 
taken. The first act a person goes through, after а problem has been 
Presented, directed toward a solution of the problem is a hypothesis. | А 
1Уро{һевїз is, therefore, interposed between а problem and its solution 
4s Fig. 5.1 indicates. 


Hypotheses come from experience. З = 
© produce new and fertile hypotheses are the men w ho have the best 


grasp of the problems of the field and a knowledge of the general form of 
Possible solutions for such problems. It is true that many of the great 

YPothesizers” have not been able to tell how or from where their hypoth- 
eses came, But an outstanding hypothesis in the field of physics, for 
Cxample, seldom if ever occurs to а man who has not had a backgronnd of 
Xperience in the field of physics. Pure “ general intelligence" itself is 


Those men who have the ability 
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not enough to produce outstanding hypotheses. Highly intelligent law- 
yers seldom develop hypotheses in the field of nuclear physics, and vice 
versa, for the simple reason that they lack the background necessary for 
producing hypotheses in the other’s field. 

Munn’s (4, p. 246) discussion of creative thinking is relevant to a dis- 
cussion of hypothesis formation. He points out that creative thinking 
develops in a manner similar to trial-and-error learning and proceeds 
through four stages: preparation, where the person gathers his background 


HYPOTHESIS Г > VOT A SOLUTION > REJECTION OF 


FOR PROBLEM I HYPOTHESIS I 
PROBLEM I 
NOT A SOLUTION REJECTION OF 
POSED TOR HYPOTHESIS I —> FOR PROBLEM I ~~? HYPOTHESIS П 
HYPOTHESIS ut — SOLUTION FOR ACCEPTANCE OF 


PROBLEM Т HYPOTHESIS IT 
Ета. 5.1. Relationship of problems, hypotheses, and solutions. 


and training; incubation, the conscious or unconscious (some say) соп- 
tinuance of associational activities; inspiration, when the material sud- 
denly seems to organize itself; and verification or revision, where one 
evaluates and revises the idea. 

Students who are faced with the need for “doing a piece of research” 

often complain that they cannot find a problem “on which to experi- 
ment." What they really mean is they have no answers to suggest. 
Problems are easy to find but good, testable hypotheses with some chance 
of acceptance are hard to find. 
R Discovery has to do with hypotheses, not data. Benjamin (1, p. 173) 
is particularly clear on this point. Since all researchers aim at scientific 
discovery, their hypotheses are “outstretched arms” reaching for the 
truth. The solutions to all problems already exist. The researcher must 
simply offer suggested answers and then accept or reject these answers in 
light of the facts. 

Hypotheses have their beginnings in two places, facts and theory. 
There were facts first, and then there were hypotheses. From the obser- 
vation of facts, man began to classify and put together piece by piece the 
web of scientific explanation. As more and more facts were accumulated 
and classified, the patterns of natural laws began to take shape, and at 
last man could predict to some extent the occurrences of nature about 
him. He began to know that this plus this leads to this. At this stage be 
had a theory. Now he was prepared to do more than catalogue facts. 
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He was now ready to go beyond facts. Was it not Huxley who said, 
“Those who refuse to go beyond fact rarely get as far as fact”? Man was 
now going beyond fact to the next stage called theory. His theories and 
laws were composed of statements describing the relationship existing 
between the facts he had been observing. Now, armed with theory, he 
could go beyond the fact gathering stage and could start to make higher- 
order hypotheses such as, if this leads to this and that leads to that, then 
they must lead to such and such. Looking there, he either found that the 
fact supported what he had theorized or that he had made a wrong pre- 
diction and consequently a poor theory. If he were right, then a new fact 
was discovered, Wherever these new hypotheses lead the scientist, he 
must keep his feet on the ground and realize that he started with fact 
and must end with fact. There is no better way to test whether the 
theory that started in fact now allows the researcher to predict new facts 
than to put the theory to a test by calling it a hypothesis and appealing to 
fact again to see if the facts support the theory. Some researchers have 
had so much faith in their theories that when the facts failed to support 
the theory they felt compelled to throw out the facts. This is, of course, 
the cardinal sin of scientific endeavor. 
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CHAPTER 6 


INDEPENDENT AND DEPENDENT VARIABLES 


After the statement of the problem under investigation and the formu- 
lation of the hypothesis, the researcher is now prepared to design an 
experiment for the specific purpose of testing whether his hypothesis is to 
be accepted or rejected as an answer to his problem. 

If the problem was clearly stated and the resulting hypothesis formu- 
lated to answer the problem specifically, then much of the work of design- 
ing the experiment is completed. The hypothesis, if well conceived, con- 
tains two all important elements: (а) an independent variable and (b) à 
dependent variable. 

An independent variable is that factor manipulated by the experimenter 
in his attempt to ascertain its relationship to an observed phenomenon. 

A dependent variable is that factor which appears, disappears, or varies 
as the experimenter introduces, removes, or varies the independent 
variable. 

Munn (2, p. 29), Andrews (1, p. 7), and Woodworth (3, p. 2) offer 
further definitions of independent and dependent variables. 

In psychology, we speak of stimuli and responses. We say that a 
response is due to a stimulus or a stimulating situation. In the absence 
of a stimulus no response can occur. An organism is considered dead 
when it is no longer capable of making responses to stimuli. The inter- 
play of stimuli and responses in the human being is vastly complicated due 
to the numerous response mechanisms it contains. Since these response 
systems are the means by which the behavior of the individual is demon- 
strated, we see that much of what is called psychology today involves the 
study of the responses of the individual to stimuli. In most psychological 
experiments, therefore, the independent variable is the stimulus variable 
and the dependent variable is the response variable. 

A few examples of hypotheses with their independent and dependent 
variables indicated are given below. 

Hyrornesis 1. А blow delivered to the patellar tendon of the bended 
knee of an individual will cause the leg to straighten. 

Independent Variable. The blow delivered to the patellar tendon of 
the bended knee of an individual. 

52 


INDEPENDENT AND DEPENDENT VARIABLES 53 


Dependent Variable. The straightening of the leg of the individual. 

Hyvornrsis 2. The higher the intensity of a 1,000-cycle note, the 
faster an individual can react to its onset by removing his hand from a 
push button. 

Independent Variable. The various intensities of the 1,000-cycle note 
presented to the subject. 

Dependent Variable. The length of time required by the individual to 
remove his hand from a push button after he hears the onset of the sound. 

HyrornzEsms 3. Individuals whose parents were feeble-minded have 
lower intelligence than do individuals whose parents were not feeble- 
minded, 

Independent Variable. 


in the parents, А 
Dependent Variable. The amount of intelligence possessed by the 


individuals whose parents were feeble-minded as compared to the intelli- 
Sence of those whose parents were not feeble-minded. 

In these simple and not completely defined hypotheses we see that the 
independent variable is presented as a proposed antecedent to the depend- 
ent variable, which is the assumed consequence. An inference of cause 
and effect between the independent and dependent variable is the object 
Sought by the experimenter. The experimental evidence of a relation- 
ship between the independent and dependent variable is taken as support- 
ng the inference. me эь Eod 

Very often the student will have difficulty in ascertaining just which is 
the independent variable and which is the dependent variable. There is 
а little device which seems appropriate for presentation here because it 
Seems to serve as an eye opener for many students. In the following 
diagram (Fig. 6.1) the reader sees a sector of a circle. At the point of the 
drawing are the letters D.V., which stand for dependent variable. At the 
Upper left part of the drawing are the letters I.V.1, standing for the first 
Condition of the independent variable. At the upper right part of the 
drawing are the letters I. V.» standing for the second condition of the inde- 
Pendent variable. Note that the are drawn between the two conditions 
9f the independent variable is drawn as а curved double-headed arrow 
“nd indicates movement between condition one and condition two. Also 
note that the lines connecting each of the two conditions of the ш. 
е Уа, respectively, to the dependent sails tome ba yen 

SY а i г і endent variable towar і 
Variable. pee ee ры be symbolized and incorporated into 


this qi Td thehypothesis can beinstantly analyzed 
at. Whenthisis done, а related component parts, 


and simpli is diagram into its 
Simplified by the use of this diag : + peri- 
e T cae еф and dependent variables. In this manner, the experi 


'The presence or absence of feeble-mindedness 
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ment to be performed is immediately made clear because once the inde- 
pendent and dependent variables are selected, and the relationship 
between them made clear, the experiment has reduced to a point where 
its intent is obvious to all. 

It would perhaps be well here to select for careful discussion a few 
different hypotheses on the basis of their demonstration of the general 
broad types of hypotheses one encounters in the usual type of experimen- 
tal research. Each of these hypotheses will then be put on the diagram 
in the correct fashion to bring out and clarify the relationship between the 
independent and the dependent variables. 


CONDITION ONE OF THE CONDITION TWO OF THE 
INDEPENDENT VARIABLE INDEPENDENT VARIABLE 
IM : 1У, 
ом. 


THAT WHICH IS TO 

BE MEASURED IN THE 
EXPERIMENT AS 
INFLUENCED BY THE 
INDEPENDENT VARIABLE 


Fic. 0.1. Relationship of independent and dependent variables. 


Prosiem 1. Is the reaction time to a visual stimulus faster than the 
reaction time to an auditory stimulus? 

Hyrornesis. The reaction time to а visual stimulus is significantly 
faster than the reaction time to an auditory stimulus. 

The first question to ask in the quest for variables is, “ What is going tO 
be measured in this experiment?" We see that we are interested in three 
things: light, sound, and the length of time it takes to react to each of 
these. Our experiment is one which will yield an indication of the spee 
of reaction under each of the two conditions of light stimulation and soun 
stimulation. It is clear that we are going to measure reaction time. 
Since this, then, is the behavior that is going to be measured under each 
of the two conditions of stimulation, it must depend on the two types 0 
stimulation, and thus if it varies under the two conditions, its variance 
will depend on the difference between the influence of the two variables- 
Reaction time is our dependent variable and is, as we see, recorded on the 


INDEPENDENT AND DEPENDENT VARIABLES 55 


diagram at the appropriate place in Fig. 6.2. The next step is to go back 
to the hypothesis and see what two conditions were mentioned as being 
related, or suspected of being related, to the dependent variable in the 
form of antecedent and consequence. We see that the two conditions of 
light and sound are all that are left and are the independent variables of 
the experiment. The variation of 

each of these two conditions inde- бнт SOUND 
pendently is hypothesized to be yy, туг 
related to the variations in the 

dependent variable. We therefore 

record on our diagram, as the first 

condition of the independent varia- 

ble, light stimulation, and, as the 

second condition of the independent 

variable, the condition of sound ом 

stimulation. This process is given REACTION TIME 


in wha: obeabackward Fre. 6.2. Relationship of the independ- 
шау авап ent to the dependent variable in a 


order, since the dependent variable hypothesis comparing two stimuli as to 
was located first. There is nothing their respective effects on a response. 


magical about locating and defining | 
the dependent variable before the independent variable. It just seems 


that once the dependent variable is isolated, the task of finding the inde- 
pendent variables is much simpler. Besides, it is usually easy to locate 
in any hypothesis the thing that is to be measured. Since the thing to 

e measured is the dependent variable, it can be identified and gotten out 
of the way, thus revealing the independent variables more easily. 

In the above problem, we saw that the two conditions of the independ- 
ent variable involved two classes of stimuli, light and sound. The dia- 
gram would have worked equally well if we had been dealing with the type 
of hypothesis where we have various conditions of the same class of 
stimulus. In this type of problem setting one is interested in what effect 
Various intensities of a particular stimulus will have on some dependent 


vari ri xemplifies this type. 
сома ntensity of the light used as ће 


Prosiem 2. Will the greater the ir 
stimulus in the reaction-time experiment be related to a greater speed of 


Teacti; i А { 
тш Increases in the intensity of the light ш per 
tion-time experiment will be significantly related to faster reaction to the 
light. 
Here it is obvious that we are ag 
and as such it becomes our dependent | 
ble will be each of the various intensities 


ain going to measure the reaction time 
t variable. Our independent varia- 
of light used in the experiment. 
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The following diagram (Fig. 6.3) shows this type of relationship between 
the independent and the dependent variables. 

A third type of situation may arise where the experiment has to do with 
a problem in which the independent variable is in the form of the presence 
and the absence of some stimulus or stimulating situation. The following 
example will demonstrate this. 

Prosiem 3. Will students who complete a how-to-study course make 
higher honor-point averages than students who have never taken such a 
course? 


MEDIUM INTENSITY 


OF LIGHT 
IVa 
LOW INTENSITY HIGH INTENSITY 
OF LIGHT OF LIGHT 
IM 1V3 
D.V. 


REACTION TIME 


Fic. 6.3. Relationship of the independent to the dependent variable in a hypothesis 
comparing different intensities of a stimulus as to their respective effects on a response. 


Hyroruesis. Students who have completed a how-to-study course 
will make significantly higher honor-point averages than students who 
have never taken such a course. 

The thing to be measured here is the honor-point average. The honor- 
point averages of the two groups thus become the dependent variable. 
The condition upon which the honor points may depend is whether or not 
the students completed a how-to-study course. These conditions become 
the independent variables. Figure 6.4 shows this relationship. 

The most clear-cut experiments are those that contain only one inde- 
pendent and one dependent variable. However, there is nothing unscien- 
tific in measuring and recording the effects of one independent variable on 
several dependent variables. "The following hypothesis with its variables 
will demonstrate this. 

НүротнЕзїз. When a person becomes startled as the result of a loud 
noise, his arterial pulse rate increases, he perspires, and the pupils of his 
eyes dilate. 

Independent Variable. The loud noise producing the condition of 
being startled in the person. 
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Dependent Variable. Increase in arterial pulse rate, perspiration, and 
the diameter of the pupils of the individual’s eyes as the result of the 
startle occasioned by the loud noise. 

Each of these physiological dependent variables can be measured simul- 
taneously and independently. In this way the experimenter can gather 
more data than if he limited himself to the measurement of only one 
dependent variable. 


COMPLETED DID NOT COMPLETE 
HOW-TO - STUDY 


HOW-TO -STUDY 
a KC 
IM IV? 


D.V. 


HONOR POINT AVERAGE 
Fic. 6.4, Relationship of the independent to the dependent variable in a hypothesis 
comparing the presence and absence of a stimulus as to its effect on a response. 


Although it has been said that the ideal condition is to have only one 
independent variable, it does not necessarily follow that it is impossible 
to perform successfully an experiment containing two or more independ- 
ent variables, Recent developments in the area of statistics have made 
available to the experimenter certain statistical techniques, particularly 
those dealing with the analysis of variance, partial correlations, and 
multiple-factor analysis, which permit him to analyze and relate changes 
in the dependent variables to the contribution of each of many independ- 
ent variables acting simultaneously. 
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CHAPTER 7 


CONTROL OF THE EXPERIMENT 


No experiment is better than its poorest control. This statement is 
the major issue involved in the evaluation of any experimental attempt to 
arrive at factual knowledge. In this chapter will be discussed the mean- 
ing of “control” and how the control of a situation is accomplished. 

When an experimenter wishes to apply scientific methodology to the 
solution of a problem, he most often turns to his laboratory as a place for 
conducting the experimentation. He does this so that he may not only 
have at hand the tools and techniques for carrying on his experimentation 
or so that he may be fully prepared to observe and record his data as it 
appears, but he goes to the laboratory so that he may be able to set up a 
stable environment in which the phenomena under observation can occur. 
In addition, he wishes to be sure that the phenomena he is studying is 
"pure" in the sense that he wants to make certain that only the phenome- 
non he wishes to observe is present and that it is allowed to vary only in 
response to the stimuli he presents to it. He deliberately removes the 
phenomenon from its place of natural occurrence in the world outside the 
laboratory and brings it into what some have said is an artificial environ- 
ment. These critics claim the phenomenon is thus changed. This latter, 
however, is not true, for the simple process of bringing a phenomenon into 
the laboratory does not necessarily change the phenomenon. If one were 
to say that it does, then this would be equivalent to believing that chang- 
ing the place of a phenomenon is the same as changing the phenomenon 
itself. See Benjamin (2, p. 107). What is usually meant is that when 
one changes the location of a phenomenon one most often changes the 
environment in which it occurs. This does not necessarily happen, for 
the scientist attempts to change the location of the phenomenon without 
changing its environment. Whether this can be done or not is dependent 
upon the ability of the scientist. The attempt to produce a phenomenon 
in a pure condition by regulating its environment is called “controlling 
the situation” or “controlling the experiment.” 

To control a situation is to have it so much under command as to be 
able to enumerate the factors present and to manipulate them at will. 
Seldom is such a position attained in an experiment. One must be satis- 
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fied with a degree of control over the known relevant factors. However, 
the experimentalist should constantly, both before and during the experi- 
ment, and especially before, attempt to Jengthen the list of known relevant 
variables. 

The following (Fig. 7.1) may help to show the part played by controls 
in an observation. In any experiment we attempt to relate the presence 
or variation of an independent variable to changes in the dependent varia- 
ble. It has previously been implied that if we wish to determine most 


c 
o 
N 
T 7 
ENVIRONMENTAL SUBJECT'S SUBJECT'S 
STIMULI Н | RECEPTORS EFFECTORS 
o 
Si —— | L R, E, 
Sa — a Rz Ez OBSERVATION 
INDEPENDENT DEPENDENT je 
5; R, Е, VARIABLE 
VARIABLE: BEHAVIOR 
S, — | c R, E, 
Sn — |o Rn En 
N 
T 
R 
о 
L 
s 


Ес. 7.1. The part played by controls in an experiment. 


Precisely the influence of an independent variable we must have only one 
such variable present. This is reasonable in that if more than one varia- 
ble were present when the dependable variable changed in value, the 
researcher would have difficulty determining which factor was really 
related to the change or if all were necessary for the change. How often 
we hear someone make a statement such as, “Tom and Pete were here, 
and I don’t like him.” To make sense from this statement the listener 
must counter with the question, “Which one don’t you like, Tom or 
Pete?" ‘The issue involved is clear: the antecedent for a consequence 
must be established and the reference made unequivocally if meaning is 
to be obtained. У 

The relevant variables must be ascertained in any experiment. "There's 
the rub. The meaning of relevant variables was previously mentioned 
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but not explored; so let us now look at methods of determining relevant 
variables in an experiment. 

The first step in approaching a problem is to find in the literature those 
studies pertinent to the area in which the problem to be investigated rests. 
Usually an investigator searches in the literature for previous studies 
dealing with the same dependent variable to be investigated in the present 
study. When such studies are located, their results will provide informa- 
tion concerning the relationship between the independent variable used 
in each and its relationship to the dependent variable. These previous 
studies have, in effect, determined the relevance of certain variables 
which must be considered for control іп an experiment. The investigator 
will probably be considering the manipulation of some independent varia- 
ble not previously investigated and will want to control all known relevant 
factors related to a change in the dependent variable. 


The Control Group 
The procedure of control is usually accomplished through the use of a 
second group of subjects called a control growp (see Fig. 7.2). The 
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Fic. 7.2. The parts played by the control and experimental groups in an experiment. 
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behavior of the control group is compared with the behavior of the experi- 
mental group. The major difference between an experimental group and 
a control group is that the independent variable is introduced to the 
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former but not to the latter. Thus the control group’s result reveals the 
behavior of the dependent variable in the absence of the independent 
variable. The experimental group’s results show the behavior of the 
dependent variable in the presence of the independent variable. Ifa con- 
trol group is not used, and only the experimental group received the inde- 
pendent variable, an investigator can never be sure but what the same 
change in the dependent variable would have occurred in the absence of 
the independent variable. 

An example of the use of a control group in a psychological experiment 
is seen in the following. Suppose an investigator believes that he has 
found a drug or chemical which if administered to feeble-minded subjects 
will raise their intelligence quotients. In order to test the effectiveness 
of his drug, he would make it the independent variable in an experiment, 
and the intelligence quotient of his group of subjects the dependent varia- 
ble. If he were simply to administer the drug to, let us say, one hundred 
subjects and then again measure their I.Q.'s, how might he interpret his 
data if he found a significant increase in the I.Q.'s? | 

The investigator could not say that the increase in I.Q. was caused by 
the drug he administered. Why not? Because he would not know 
whether the I.Q.’s of the subjects would have raised even if he had not 
given them the drug. It is possible that the subjects were more highly 
motivated on the second administration of the test than they were on the 
Further, the entire group might have received a 
sed to a more favorable environment, and been 
given closer and perhaps better medical attention because they were under 
observation, or perhaps there were certain transfer effects or carry-over 
from the first to the second administration of the tests. Any one of these 
conditions, and many more, might have been responsible for the apparent 


increase in I.Q. 


first administration. 
better diet, been expo 


In order to find out just what changes were due to the influence of the 
drug alone, the careful experimenter would include in his study a control 
group. This control group would be treated in exactly the same manner 
as the experimental group with one important exception, that being, 

this group would be given a harmless, non- 


instead of receiving the drug, cu 
effective chemical such as common table salt. Such a device is called a 


placebo. However, the subjects would not know whether they Were mem- 
bers of the experimental group or the control group. Very likely, the 
safest procedure would be to administer the drug and the placebo to the 
two groups without the subjects realizing that they were serving in an 
experiment. The drug and the placebo could be administered in capsule 
form before each meal and the subjects told, if necessary, that they were 
being given vitamins. Now, if the experimenter had put his subjects into 
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two groups of fifty each and treated each of them the same, with the 
exception of the fact that one group received the drug and the other 
received the placebo, then he could, after the second administration 
of the test, note if there were any increase of the experimental group’s 
1.08 over the control’s. If such a difference occurred, and if it were 
significant, then he would have more reason to say that the increase 
was due to the effect of the drug than if he had not used a control group 
for comparison. 

Andrews (1, p. 10), Underwood (6), Munn (5, p. 30), and Larrabee 
(4, p. 333) present discussions of controls and the control group. 


Equating the Control and the Experimental Groups 


We have indicated that it is necessary before the introduction of the 
independent variable to have the control and experimental groups equal 
in respect to their possession of variables relevant to the dependent varia- 
ble being measured. This means that if an investigator has reason to 
believe or even suspect that a particular difference in his two groups would 
either directly or indirectly influence the response of his two groups to the 
independent variable imposed upon them, then he is bound to see that his 
two groups are equated with respect to that relevant variable. This is 
not an easy task, for not only is it difficult to know the relevant va: 
but it is often even more difficult to see th; 
two groups. Three methods are common 
ter in his attempt to equate his groups. 

Matched-pairs Technique. 
one by one and are selected fo 


riables, 
at their effects are equal in the 
ly employed by the experimen- 


the groups will be matched, a 
It is obvious that “ 


stringent that only 
instances the group 
will be selected mus; 
the final groups. 


ill be acceptable. In such 
which the final two groups 
have a fair-sized sample in 
are available from which 
vant variables are known 
is a handy and useful device, nee of easing Che gous 


In this method the experimenter does not 
dual with each other individual, but rather 
€ average possession and extent of distribu- 
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tion of the important characteristics of the groups, with respect to the 
relevant variables, is the same for each group. He might tentatively 
assign half of his subjects to the experimental group and half to the con- 
trol group and then proceed to find the central tendency and the varia- 
bility of the two groups. If it were found that there were no significant 
differences between these statistical measures, then it might be assumed 
that the groups were fairly well equated. If differences were found, then 
exchanging subjects between the two groups would aid in equating them. 
It is necessary, as indicated above, that both the average possession of a 
trait and the distribution of that trait around the average be the same 
for the two groups. Suppose the experimenter assumed that his two 
groups of subjects were equal in intelligence because they each had an 
average I.Q. of 100. Further examination of the distributions of I.Q.'s 
might show 60 per cent of the subjects in one group have I.Q.’s below 100, 
and 60 per cent of the subjects in the second group have I.Q.’s above 100. 
These groups could not be considered equated in I.Q. until there were no 
significant differences in the distribution of I.Q.’s as well as in the average 
LQ.s. Calculation of statistical measures of variability of the two groups 
(discussed in the chapters on statistics) serves as а means of comparing 
the variability of two groups. К : 
Randomized Group Technique. If an experimenter finds that he is 
unable to match his two groups, either because he is unable to decide upon 
the most important factors upon which to equate them or because he can- 
not measure or perhaps even discover the relevant factors, then it is sug- 
gested that he make use of the process of randomization in equating his 
groups. This technique, however, also demands a large number of cases, 
for an experimenter must make his assignment of the subjects to the 
groups upon a chance basis, and in order to give chance differences an 
opportunity to nullify each other, he must use many subjects. It can be 
shown that as the number of subjects selected randomly increases, the two 
groups become more similar. | . . 
For a more complete discussion of the techniques of equating experi- 
mental and control groups the reader is referred to Jahoda, Deutch, and 
Cook (3). А " " 
A control group is not essential, however, in performing an experiment 
Wherein various intensities of the independent variable are given to the 
Tn this instance, the experimenter is interested in 


experimental group. 2 
the concomitance of variation between the independent and dependent 


variables and not in the presence or absence of the independent variable 
аз related to the occurrence of changes in the dependent variable. Rele- 
vant variables must still be controlled, nevertheless, even if a second group 


for control is not used. 
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Techniques for Controlling Experiments 


Once the relevant variables are known, their effects must be eliminated 
from the experiment. There are several ways to do this. 

Method of Removal. If possible, the relevant variables should be 
removed from the experimental situation. If, for example, it is known 
that light and noise influence the dependent variable under investigation, 
then the experimenter should remove these conditions through the use of 
a lightproof and sound-deadened room. 

Method of Constancy of Conditions. As is often the case, the effects of 
certain known relevant variables cannot be completely or even partly 
eliminated. For instance, age is a known relevant variable which affects 
the behavior of most dependent variables. Since it is obvious all subjects 
must have age, elimination of this variable is impossible. Control over 
the variable in such instances is secured by the means of keeping the varia- 
ble constant for all the subjects used in the experiment. In this manner, 
if all the subjects were of the same age, the effect of age on the experimen- 
tal group balances its effect on the control group. 

When using a control group, it is not always absolutely essential to 
know which relevant variables should be removed. The control and 
experimental groups may be equated before the experiment in such a way 
that they represent random samples of the same population. By this 
procedure, one has two groups with the best chance of being equal in all 
respects. In such a selection of the two groups, there will be a constancy 
of conditions between them that will extend to factors beyond the experi- 
menter's ability to know, and thus remove, or even designate. 

Screening Method. Variables may be controlled by what is known as 
screening them out. Suppose in an experiment the measurements of the 
dependent variable might be influenced by some uncontrollable sound 
which occurs unexpectedly, if not erratically. An example would be the 
ringing of a buzzer to announce the end of class periods. Such an audi- 
tory disturbance might easily occur at a crucial point in the experiment 
and upset the results. "The influence of the sound could be eliminated by 
producing a sound in the laboratory loud enough to screen out the buzzer 
sound if it occurred. If the deliberately produced sound were constant, 
it would perhaps have an effect on the results, but the effect would be 
known and apparently equal for all subjects. 

Counterbalancing Method. In many experiments it is necessary to con- 
trol for an apparent progressive change in the subject’s response as he 
continues to serve in the experiment. Practice effects and fatigue effects 
are so often present in psychological experiments that they are referred 
to as constant errors. These constant errors must be controlled in any 
good experiment or their effects will obscure the changes in the dependent 
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variable which is being investigated as related to an independent variable 
other than practice and fatigue. The simplest way to control such con- 
stant errors is to use the process known as counterbalancing. Suppose 
that an experiment is being performed wherein two light stimuli, red and 
green, are being presented to the subject and the object of the experiment 
is to measure for comparison the reaction time of the subject to each color 
of light. If the experimenter presented the lights in the sequence red- 
red-green-green, the combined effects of practice and fatigue of dealing 
with the red stimulus would be present when the subject was finally 
presented with the green stimulus. The effect would probably be seen 
in the subject’s response to the green stimulus, and thus give different 


SUCCESSIVE TRIALS A B 8 A 
EFFECT ON RESPONSE. 1 2 3 4 


WDITIO. 1+4= 
TOTAL EFFECT OF CONDITION A + Ss same 
TOTAL EFFECT OF CONDITION B 2+3=5 


SUCCESSIVE TRIALS A A 8 B 
EFFECT ON RESPONSE 1 2 3 4 


7 = 
TOTAL EFFECT OF CONDITION А 1+2 3 DIFFERENT 
TOTAL EFFECT OF CONDITION B 3+4=7 
Fra. 7.8. Comparison of the sequences abba and aabb to show how the effects of con- 
Stant errors on the response can be better equalized by an abba sequence. 


results than if the sequence green-green-red-red had been used. In this 
latter case, the results of the subject’s reaction time would contain the 
error occasioned by practice and fatigue from dealing with green, The 
counterbalanced order of presentation solves this problem by making use 
of an abba sequence of presentation of the stimuli. Thus the red and 
green stimuli should be presented in the sequence red-green-green-red or 
green-red-red-green. By using the abba sequence the changes in the 
dependent variable attributed to constant errors are spread equally over 
all conditions. 

Underwood (6, p. 30) indicates that the assumption behind the use of 
the abba sequence is the idea that “the progressive change in response 
which may take place as experimentation proceeds is a straight line func- 
tion.” This means that if the stimulus variable under study, and no 
other stimulus variable, equally influences the response on each trial, then 
the effect of the stimulus on the response should be such that the total 
effects of the systematic errors would be the same throughout the 


experiment. 


In Fig. 7.3 it is seen that when the sequence abba is used and the accu- 
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mulative effect on the response following each presentation of each stimu- 
lating condition is considered to increase by one on each trial, then it 
becomes obvious that the total effects of conditions а and b can be 
equalized only by the abba sequence of presentation. Underwood 
(6, p. 31) presents this idea in graphical form and deals with the average 
influence of each block of trials instead of the total effect. Hisis probably 
a more accurate presentation, but of necessity it is a little more complex. 

Method of Systematic Randomization. When more than five conditions 
are to be counterbalanced, the procedure becomes difficult to handle, 


PRESENTATION OF CONDITIONS 
ABCD 


Fro. 7.4. Systematic randomization table for four conditions, four subjects, and 
four trials. 


particularly if all subjects are to be tested under all conditions. It is 
suggested that in such instances the method of systematic randomization 
be used, The name of this method appears to involve a contradiction, 
for how could something be systematic and at the same time random? 
The following discussion should help to clarify this matter. 

If an experiment required the use of more than five conditions, and each 
subject was to be exposed to all the conditions in a sequence, it is obvious 
that the issue involved is one of deciding what order of presentation 
should be used for each subject so that practice and fatigue effects may be 
the same for all conditions investigated. If nonsystematic randomiza- 
tion were used, that is, chance alone decided which subject would receive 
the conditions in which order, the experimenter would need a large num- 
ber of subjects before he could be sure that each condition occurred 
equally often at each stage of practice. However, if a system were 
imposed so as to ensure randomization, i.e., each condition preceded and 
followed each other condition about equally, but not necessarily that 
every possible combination was used, then the experimenter could be 
certain that randomization was effected even when dealing with a few 
subjects. Figure 7.4 illustrates this method. 
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These methods of controlling psychological experiments do not com- 
prise the entire list but are rather the most commonly used devices. 

It is through the application of controls that experiments become 
capable of being duplicated. Any good experiment must be repeatable 
and still yield the same results. This is possible only if the experimenter 
has carefully controlled all relevant factors and reported his controls in 


detail. 
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CHAPTER 8 


PROCEDURE FOR EXPERIMENTATION 


In this chapter there will be discussed several methods of procedure 
which have been utilized in the past by psychologists and which may be 
considered standard procedures for the types of experiments where they 
apply. It is wise for the beginner to use a standard and well-defined pro- 
cedure in his experiment wherever possible. By so doing, he is less likely 
to go astray than if he set about designing new methods of procedure 
himself. 

Since the psychologist is interested in the investigation of all possible 
relationships of stimulus variables to response variables, he must on some 
occasions use procedures which allow him to collect data under obscure 
conditions. Sometimes he simply cannot use an apparatus to measure 
the behavior of an individual, but must deal instead with such intangibles 
as judgments by the subject. The question in such instances becomes 
centered around the selection of a procedure which when used will yield 
reliable data. 


Methods of Expression and Impression 


If we measure the internal and external changes in the behavior of the 
individual by means of observation, often aided by detecting apparatus, 
we would be using the method of expression. 

An apparatus called a lie detector exemplifies this. In such an applica- 
tion of the method of expression, the experimenter utilizes various devices 
that will record the subject’s physiological changes. We know that when 
an individual experiences an emotion certain physiological changes take 
place in his body. Lying is an emotion-provoking experience for most 
individuals. Thus if we are prepared to measure the change that takes 
place in a subject’s respiratory rate, his psychogalvanie skin response, and 
his blood pressure when there is a possibility that he may lie in response 
to a question, and compare these changes in his physiological functioning 
to his normal emotional level when he is answering “harmless” questions, 
we may relate his emotionality to lying. 

Much of the psychology of an individual is covert, that is, the person is 
experiencing responses to stimuli but gives no apparent overt behavior 
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response. An unspoken judgment is such an experience. To make such 
experiences overt, the subject is instructed to state his impression of the 
stimulus or stimulating situation. Thus we are employing a procedure 
called the method of impression. 

Woodworth (8) treats the subject of methods of expression and impres- 
sion in detail. 

Regardless of which of the two previous methods is used (and they 
are not essentially different), one main objective is sought: the experi- 
mentalist is attempting to quantify qualitative behavior as a result of 
stimulation, This means only that he wishes to convert the behavior 
observed into numbers so that he can more readily deal with it. The 
researcher deals with these numbers, which are actually symbolic repre- 
sentations of the amount of a quality present, and attempts to reduce 
these numbers to meaningful concepts expressed in terms of trends, 
relationships, and the like. While certain errors are made in going from 
qualities to quantities, it is even more probable that errors will be made 
when the experimenter attempts to return from quantities to qualities 
and make his newly calculated statistical ratios meaningful in terms of 


qualities again. 


Psychophysical Methods 

Several procedures falling mainly under the classification of methods of 
impression are known as the psychophysical methods. These psycho- 
physical methods are procedures by which the experimenter may quantify 
relations between a stimulus and the sensation or experiences that follows. 
The best single reference for this topic is Guilford’s Psychometric Meth- 
ods (4), 

Stevens (5) has listed seven categories into which the problems of 
Psychophysics fall. These categories are absolute thresholds, differential 
thresholds, equality, order, equality of intervals, equality of ratios, and 
stimulus ratings. In the discussion that follows, each of these problems 
will be treated with the exception of the problem of the equality of ratios. 
Certain of the problems are dealt with by psychophysical methods bearing 
the name of the particular problem. The name of the method will be 
Presented as a heading. Тһе method will then be discussed as to its 
characteristics and applicability to the problems of psychophysics. 
1 Exploration, or Method of Just 


Method of Limits (or Method of Seria 
oticeable Difference, or 


Noticeable Difference, or Method of Least N 
ethod of Minimal Change) 


The procedure involved in this psychophysic 
experimenter gradually lowering the intensity or va 


al method consists of the 
lue of a stimulus until 
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it is no longer perceived by the subject, or by increasing or decreasing 
the value between two stimuli until it becomes just noticeably differ- 
ent (JND), or by increasing the value of a stimulus until it is no 
longer perceived. 

Аз can be seen from the above synonyms for the method of limits, the 
use to which the method is put decides the name by which one identifies it. 
However, the basic idea of establishing limits is contained in all variations 
of the method of limits. Usually the method is used to ascertain the 
threshold of a subject’s sensitivity. 

At а given moment, à stimulus must achieve a certain intensity in order 
to be perceived. This value of the stimulus is known as the absolute 
threshold or stimulus threshold. It isa point on the physical continuum of 
the stimulus. The difference in stimulus value between the zero value of 
the stimulus and the absolute threshold is called the absolute limen. 
Because sense organs operate efficiently only within certain ranges of 
stimulus intensity, there is an upper limit above which some stimuli, 
sounds, for example, are not perceived by the individual. This upper 
threshold is called the terminal threshold or terminal stimulus. One other 
type of threshold is used frequently. It is called the difference threshold, 
and is established by varying a stimulus from the intensity of an identical 
constant stimulus and increasing the difference until the subject reports 
that he perceives a difference. It is a point on the physical continuum at 
some distance from the standard stimulus. The distance from the stand- 
ard stimulus to the difference threshold is called the difference limen. 
Figure 8.1 shows the relationship of the thresholds and limens to one 
another. 

Thresholds are stated in terms of units of whatever type of stimulus 
used. For instance, a subject’s absolute threshold for pitch might be 20 
cycles per second. The absolute threshold is considered an inverse meas- 
ure of sensitivity, meaning that the lower the threshold, the more sensitive 
is the subject. This means that the nearer the subject’s absolute thresh- 
old is to zero value of the stimulus, the more acute is his sensitivity to the 
stimulus. The statistical calculation of the subject’s response deviations 
from the standard stimulus in determining the difference threshold yields 
a measure of variability called the standard deviation! which becomes ап 
inverse measurement of the subject’s sensitivity. Apparently, the 
smaller the difference limen, the more sensitive is the subject to changes 
in the value of the stimulus. 

One of the questions the experimentalist in psychophysics encounters 
is, “ Just how intense a stimulus must be presented to a subject to evoke 9 
response on his part?” 


1 See the chapters dealing with statistics for a discussion of the standard deviation. 
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First of all, it should be realized that any threshold or any limen is not à 
static thing, but rather tends to vary within a subject throughout even à 
short examination period, and, of course, often varies greatly from subject 
to subject. Because this is so, the thresholds have become statistical 
entities and are defined here in statistical language as follows: a limen 
is that value of the stimulus which the subject can discriminate 75 
per cent of the time. Thus, your difference limen for sound intensity 
would be that intensity of sound that you could correctly notice as being 


INCREASING VALUE OF STIMULUS 


TERMINAL STIMULUS 
OR 
TERMINAL THRESHOLD ——>" 


DIFFERENCE THRESHOLD 

IN THE POSITIVE 

DIRECTION Se 

DIFFERENCE LIMEN 


STANDARD STIMULUS ——> ] 
} DIFFERENCE LIMEN 


DIFFERENCE THRESHOLD —> 
IN THE NEGATIVE 
DIRECTION 


STIMULUS THRESHOLD ——>- 
OR 


ABSOLUTE THRESHOLD } дезо LESLIE, 


ZERO VALUE OF STIMULUS 
Fic. 8.1. The relationship of thresholds and limens on the stimulus continuum. 


different from a standard intensity of sound on 75 per cent! of the 
comparison trials. Your absolute threshold would be that minimum 
physical value of sound that you could just notice at least 75 per cent of 
the times it was presented. The usual method used in ascertaining 
absolute and difference thresholds is the method of limits. 

The determination of the absolute threshold of a stimulus is most 
accurately performed by using an ascending and a descending series of 
Presentations. The experimenter gradually increases, in an ascending 
Series of presentations, the stimulus value from a point well below the 
Possible threshold of the subject to a point where the subject reports per- 
ception of the stimulus. Then the experimenter explores the series in a 
descending fashion by lowering the stimulus from a point well above the 

! Some have used 50 per cent as the proportion of discriminations necessary for the 
Subject to demonstrate that he can identify a difference. Since the subject could be 
‘ight 50 per cent of the time by merely guessing, the 75 per cent level is used in the 
discussion here. At best, the proportion of correct discrimination demanded is an 


arbitrary distinction. 
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perception point to a point where the subject reports no perception of the 
stimulus. The mid-point between these two determined points is taken 
as the stimulus threshold. It is wise for the experimenter to approach 
these thresholds in a systematic manner with “ catch" stimuli thrown in. 
That is, he should avoid presenting the series by a routine predictable 
raising or lowering of the stimulus. If he does not do this, the subject 
may make what are known as errors of anticipation by reporting the next 
value because he expects a change and not because a change is apparent. 
The subject may also make errors of habituation which are caused by his 
having developed the habit of reporting, for instance, the absence of the 
stimulus and continuing to report so even when the stimulus becomes 
apparent. The latter type of error is more commonly encountered. 
Underwood's (7) discussion of this topic would be of help here. 

Let us apply the method of limits to the determination of the two-point 
threshold. 

The two-point threshold is an often determined entity used by psy- 
chologists primarily to demonstrate the difference in cutaneous sensi- 
tivity in one part of the body as compared to another part. The problem 
involved in the two-point threshold determination is one of finding out 
just how far apart the two points of a piece of apparatus called an 
aesthesiometer must be for the subject to report that he feels two points 
instead of опе. An ordinary set of carpenter’s calipers and a small milli- 
meter ruler serve well as the apparatus in this experiment. 

The procedure is as follows: The experimenter applies to the subject’s 
upper arm, for example, the two points of the aesthesiometer when they 
are very close together, perhaps only 10 millimeters apart. The subject 
should have been blindfolded and the procedure explained to him only so 
far as to make sure that he understands that he is to report whether one or 
two points are stimulating him. One must be careful in applying the 
aesthesiometer so that it is always turned in the same direction. Chang- 
ing its direction from trial to trial would have an effect on the subject’s 
response and exist as an uncontrolled variable. The trials are conducted 
by increasing the distance between the two points for stimulation in а 
systematic order. The trials are continued with increasing separations 
between the two points until the subject reports two points. A wise pre- 
caution would be adding a few more trials, using a little wider distance 
between the points, so that one is sure that the subject’s threshold has 
been reached during the ascending series. The descending series of 
trials is conducted in a similar manner starting, however, with the points 
very far apart, say, 100 millimeters, and decreasing the distance through- 
out the trials until the subject reports one point. The ascending and 
descending series should be repeated a number of times. 
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The calculation of the two-point threshold of the subject from these 
data involves finding the average of all the thresholds discovered as the 
result of the ascending and descending series. Figure 8.2 shows a possi- 
ble set of hypothetical data that might be expected in such a threshold 
determination when only one ascending and one descending trial is given. 
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Fic. 82. Data sample expected for one ascending and one descending trial in the 
determination of two-point thresholds. 

The calculation of the terminal threshold presents the problem of ascer- 
taining the upper limit of the range of the subject’s sensitivity to the 
Presentation of a stimulus. The difference threshold allows the experi- 
menter to answer the problem of just how much change must take place 
in a stimulus before the subject will be able to report accurately a change. 
Both of these problems of threshold determination are met by observing 
the general procedure of the Method of Limits. 

Method of Average Error (or Method of Reproduction, or the Equation 
Method) 


In some types of experimentation it bec 
Problem of the equality of two stimuli. 


omes necessary to deal with the 
The problem might be phrased 
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as follows: if one presents two different stimuli to the subject, how similar 
in value must they be for him to report that they are equal in his judg- 
ment? This type of problem may be handled by the psychophysical 
method known as the method of average error. 

Broadly speaking, this method is used when the experimenter desires 
the subject to reproduce a stimulus accurately. The stimulus presented 
is constant, and the subject manipulates a variable stimulus until he feels 
the two are subjectively equal. A record is kept of each attempt of the 
subject in terms of the amount of error (variable error) between the sub- 
jective estimate of the stimulus and the known stimulus value. The 
average of these variable errors is established and this value taken as а 
measure of the systematic error involved in the subject’s judgment 
that the two stimuli were subjectively equal. If the subject tended 
to vary considerably in the errors he made, then he is considered to 
have less precision of response. In this way, it is believed that the 
sensitivity of the subject is determined by his consistency and variable 
error. The constant error is stated in terms of the mean, and the 
sensitivity of the subject is stated in terms of the variability, or standard 
deviation,! of his errors. The nearer his mean to the standard stimulus 
value, the less his constant error. The smaller the variability of his 
responses, the greater is his sensitivity. 

An example of this method would be demonstrated when the experi- 
menter presents to the subject, by means of an oscillator, a tone of 1,000 
cycles. The subject would be allowed to manipulate a second tone by 
means of another oscillator until he judged the two tones to be equal. 
From a comparison of the readings of the dials on the two oscillators, each 
time the subject reported the two tones to be equal, an average variable 
error could be calculated. 

A further example of the application of the method of average error 
with the presentation of some sample data expected follows. 

The problem in our particular instance is to discover how accurately 
a subject can match the diameter of a circle of light projected on a screen. 
Two projectors would be required. The first of these would project 2 
circle of light constant at three inches in diameter. The second projector 
would be adapted in such a way that the subject could by a mechanism 
adjust the circle of light it projected from 1 to 5 inches in diameter. Both 
projectors would be turned on, and the subject instructed to vary his pro- 
jector in the manner necessary to make the circle projected by it equal in 
size to the 3-inch circle produced by the set focus projector. The subject 
might be given 50 trials, and after each trial the experimenter would meas- 


1 See the chapters dealing with statistics for a discussion of the standard deviation. 


PROCEDURE FOR EXPERIMENTATION 75 


ure the size of the circle adjusted by the subject. Such data may be 
represented as shown in Fig. 8.3. 

M, in Fig. 8.3 is the point denoting the average size of the circle repro- 
duced by the subject. The diameter of the presented stimulus circle 
is the distance from A to B. The subject’s average variable error is com- 
puted by adding up all his errors in estimating diameters and dividing 
by the number of estimations he made. His constant error is the differ- 
ence between the value of his average variable error and the true size 
of the presented circle. In this case his constant error is equal to the 


Fra, 8.3. Hypothetical data expected when a subject attempts to reproduce a circle. 


distance A to M, minus the distance AtoB. The sensitivity of the sub- 
ject can be calculated by determining the variability of his estimates. 
Roughly, the greater the width of the curve L to H, the greater the sub- 


Е ject’s variability. 


The Constant Methods (or Method of Right and Wrong Cases, or Con- 
stant Stimuli Method, or Method of Constant Stimulus Differences) 


e method of establishing absolute and 


‚Тыз is the name applied to th | 
difference thresholds when the subject is requested at each trial to € 
nte 


the presence or absence of a constant stimulus which has been prese { 
to him or to compare two stimuli, one constant and one variable. This 
method is used for determinations of equality of two stimuli, the equality 


of certain intervals, and in the locating of thresholds. | 4 
In the usual application of this method the subject is confronted with 


the task of reporting to the experimenter whether one stimulus of a pair 
Presented to him is (a) stronger or weaker or (b) stronger, equal to, or 
Weaker than the other stimulus of the pair. In the first instance, it is 
Common practice to call the situation à two-category judgment, and, in 
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the latter instance, a three-category judgment. Let us talk for a moment 
about the two-category type of judgment. 

This might be a typical application of the method. A standard weight 
of 50 grams is chosen for comparison and is included in a set of weights 
having the values 30, 32, 34 grams, etc., up to and including 70 grams. 
The subject is to compare the standard weight with each of the other 
weights. The weights are presented to him in an irregular order, and he 
reports, in each case, whether the second is heavier or lighter than the 
first. The upper threshold for the subject in determining a perceptible 
difference in weight is given by the weight above 50 grams, which was 
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Fic. 8.4. A psychometric function for two categories of judgment. 


called "heavier" 75 per cent of the time. The lower threshold is deter- 
mined by that weight below 50 grams, which the subject called “lighter” 
75 per cent of the time. As can be seen, the average of these two thresh- 
old values represents the subject’s difference limen. To determine 
this average most easily, the graph shown in Fig. 8.4, which represents 
some hypothetical data, is used. A graph of this type is called the 
psychometric function for two categories of judgment. It is to be noted that 
the steeper the climb of the curves, the greater the subject’s sensitivity. 

The determination of the difference limen under a system of three- 
category judgment is the same as for the two-category method except that 
the subject reports whether the second of the two weights is heavier, 
lighter, or equal to the first. The plotting of such data is shown in Fig. 
8.5. Again the data are hypothetical. 

The addition of the third category of judgment requires that a third 
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curve be added to the psychometric function for two categories, and is 
shown as the bell-shaped curve at the bottom of the graph. This bell- 
shaped curve represents the distribution of responses when the subject 
reported the two weights to be of equal value. The difference limen is 
considered by some to be one-half the difference between the upper and 
the lower thresholds. 

Thurstone, writing in Andrews’ book (1), indicates that whether one 
uses two or three categories of judgment depends upon the purpose of the 
experimenter. If the experimenter is studying sensory discrimination 
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Fra. 8.5. А psychometric function for three categories of judgment. 
and attempting to find a limen, then he should use the two-category 
method. If he is studying the experience of equality, then he should use 
the three-category method. 
Method of Single Stimuli (or Method of Absolute Judgment) 

This method differs from the previous ones in that in using it no direct 
Comparison is made between the stimulus being judged and another 
Stimulus. Instead, the subject is presented with a series of single stimuli 
and asked to deseribe each. The standard the subject uses is his own 
and usually approximates the average of the series presented to him. 
This method would be involved in the following situation. The subject 
is Presented with a number of blocks of wood and is asked to judge the 
actual weight of each block. This is different from the method of con- 
Stant stimuli, where he would be asked which of two blocks is the heavier. 
The Subject аа built up a standard and uses it for comparison with the 


Stimuli presented. 
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Still another example of this method would be when the subject is asked 
to rate the stimulus on some scale and assign a value to it. The scale 
might consist of heavier and lighter or, instead of a two-category response, 
it might be one of three categories, such as heavy, medium, and light. In 
case the two-category type of response is to be dealt with, then the data 
are treated by finding the mean, or average, and the variability, or standard 
deviation,! of the distance between the two types of responses. When 
three categories are used, then the data are treated by finding the mean and 
standard deviation of the two extreme categories, and the width of the 
middle class. This latter yields the difference limen which is one-half the 
distance between the lower and upper thresholds. In other words, these 
data are treated the same as were the data for the method of constant 
stimuli. Occasionally, when this method is used as in an opinion survey, 
where a question is asked such as “ Ате you in favor of, or against, high 
taxes at this time,” the data may be treated by simply finding the per 
cent of the persons interviewed who respond “іп favor of” or “against” 
in answer to the question. Sometimes many categories are used, as when 
the subject must rate some stimulus as follows: 


1 2 Б] 4 5 6 7 
Exceptionally | Very Very Exceptionally 
strong strong Strong Average: | Wosk weak weak 


In treating the data from many subjects who used this scale for rating 
purposes, numbers 1 to 7 inclusive assigned to the seven categories could 
then take the place of the descriptive categories during the calculation of 
the data. The mean scale value, or perhaps better, the median, would 


serve to inform the experimenter of the judgment tendency of the 
subjects. 


Method of Paired Comparison 


Here, each stimulus of the series is compared with every other stimulus. 
The subject must judge which of two stimuli being compared at the time 
has a greater amount of whatever characteristic is being considered. 
Since each stimulus must be compared with each other stimulus, including 
itself, there are, considering n stimuli in the series, n? separate compari- 
sons. Eliminating the comparisons of each stimulus with itself, there are 
n(n — 1)/2 comparisons needed if each stimulus is to be compared with 
every other stimulus (ignoring order). The method becomes laborious 
when more than a few stimuli are to be compared. For instance, if 20 
stimuli were used and it were desired that each stimulus be compared with 


1 Discussed in the chapters on statistics. 
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every other stimulus, but not with it: i 
аа 4 € vith itself, then 20(19)/2 or 190 compari- 

This method is used when the experimenter is interested in learning the 
relative preference of the subject for the various stimuli presented. An 
example of the application of this method would be as follows. A manu- 
facturer of cosmetics is about to place on the market a new type of face 
powder. He is faced with the problem of deciding which of three different 
trade names to use for his new product. The three names he has con- 
sidered using are Smooth-On, Talcumsea, and Forbidden Tryst. He 
presents these three names for his face powder to a large sample of women 
Who represent the population to whom he eventually wishes to sell the 
product. With only three stimuli to be compared, his task is relatively 
simple. Letting A, B, and C stand for Smooth-On, Talcumsea, and For- 
bidden Tryst, respectively, his presentations of the stimuli will involve 
each woman comparing A with B, A with C, and C with B. His results 
might look very much as follows: 


75 per cent of the women preferred A to B 
25 per cent of the women preferred B to A 
15 per cent of the women preferred A to C 
85 per cent of the women preferred C to A 
95 per cent of the women preferred C to B 

5 per cent of the women preferred B to C 


The choice is obvious. The women prefer С, Forbidden Tryst. 
Method of Rank Order 

A group of stimuli is presented to the subject, and he is instructed to 
Tank them in order from the highest to the lowest in terms of some charac- 
teristic the stimuli have in common. If more than one subject assigns 
tanks to the series, then the average rank for each stimulus is computed. 

The following question is inherent in the use of this method. If the 
Subject is presented with several stimuli that are not related to each other 

У any one specific characteristic and is instructed to put them in rank 
order on the basis of some standard not included in the physical aspects 
of the stimuli themselves, what characteristics of the stimuli will he draw 
upon to fulfill his task? The answer to this question may be very difficult 
to discover, as in the case of a subject making esthetic preferences in rank- 
ing abstract art works. 

The method of rank order yields results that are similar to tho: 
Mg from the application of the method of paired comparisons. In addi- 
tion, the method of rank order is most often preferred when the number 
of stimuli is large. The method of rank order is perhaps slightly inferior 


se result- 
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to the method of paired comparisons on another account, however, 
because in the former method, the subject may not take into considera- 
tion the merits of all the stimuli, since he is not forced to do so. The 
method of rank order is not usually used if the stimuli to be compared are 
of such a nature that they cannot be almost simultaneously perceived by 
the subject. For instance, if one were to ask the subject to compare 
several tones as to loudness, the subject would have difficulty in ranking 
them unless he were able to compare each tone with each other tone at 
the same time, in which case it would seem preferable to use the method of 
paired comparisons. 

An example of this very simple psychophysical method is easy to find. 
Suppose you have the job of hiring a new professor in a university depart- 
ment. Perhaps there have been five applicants for the position and each 
applicant was interviewed and his credentials studied by each of ten staff 
members of the department. You would apply the method of rank order 
to this situation by having each of the five applicants ranked by the ten 
staff members. You would instruct the staff members to assign a differ- 
ent rank to each of the applicants, and in such a manner that the applicant 
most preferred received the rank of one, the one next preferred the rank 
of two, ete., until the one least preferred received the rank of five. The 
average rank for each applicant should be found. You would hire, 
according to the dictate of this method, the applicant receiving the lowest 
mean rank. Sample hypothetical data follow: 


Staff members 


Applicant Mean rank 
1/2/3)4]5 


© 
x 
oo 
2 
© 


А 4|5|4/2]3/5|5|4|3]|4 3.9 
B 3|4|1/5|5|1]|2|1[|5]|5 3.2 
с 112121112 4|3| 21 1.9 
р 2:1|83|3]|]2|3|1|2/1]|3 2.1 
E 5|3|5/4|4|5|3|5|4|2 4.0 


Applieant C is ranked first. 


Method of Equal Appearing Intervals (or Method of Mean Gradation) 


Two different stimuli are presented, and the subject is requested to 
adjust a third stimulus until it appears to bisect the “sense distance” 
between the two. Again, this method is being used if the subject is given 
a group of various stimulus objects representing a wide range of charac- 
teristics to be dealt with and is instructed to sort the objects, according to 
some characteristic, into a definite number of piles or categories which 
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appear equally spaced to him. If more than one subject is used, then the 
mean scale position is calculated for each stimulus and compared with 
the real categories involved as determined by actual measurement where 
possible. 

Ordinarily, this is not possible, since it is, as was previously pointed 
out, very difficult for the judges to define the aspects of the stimuli that 
allowed them to make their decisions. Ап example of the application of 
this method in a practical situation is presented below. 

A young instructor who had just received an appointment in the psy- 
chology department of a university found that one of his duties was to 
grade laboratory reports turned in by the students in the laboratory sec- 
tions of general psychology. Since he did not have much experience in 
grading such reports, he decided to use the method of equally appearing 
intervals to help build up a standard for grading the papers. 

The problem involved assigning five different letter grades to the 
Papers, A, B, C, D, and F. Thus the instructor had 5 categories with 
which to work. He secured 50 laboratory reports that had been turned 
in the previous year by students enrolled in the course, and, after remov- 
ing all identifying marks, and previously assigned grades, he gave the 
Papers, in turn, to each of the other 5 laboratory instructors. He 
requested that they sort the papers into 5 piles equally spaced so that pile 
1 represented the best work and pile 5 the poorest. 

Each of the instructors complied with the instructions (under protest), 
and a record was kept of the interval into which each paper was sorted 

У each instructor. The data then appeared as follows: for each paper 
there were five judgments as to which interval it should occupy. A mean 
Scale value was calculated for each paper. Also a standard deviation was 
calculated, but proved meaningless, due to the small number of cases. 
However, it did, perhaps, roughly show the amount of variability of 
Opinion among the judges concerning the interval any given paper should 
occupy, This variability determined whether the paper was a poor fit 
for any one interval or one upon which most of the judges agreed. 

The instructor then threw away all papers on which there was too much 
disagreement, and placed the remaining papers in five piles according to 
their mean scale value. He named these piles by his letter grades, and 
Studied the contents of each pile until he began to form the concept, or 
Perhaps a general impression, of what were the essential components of a 
Paper that caused it to be graded in terms of one letter instead of another. 


General Use of the Psychophysical Methods 
One may look at psychophysics as Boring (2, p. 294) claims James did, 
and agree with James that “the proper psychological outcome was just 
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nothing." Yet on the other hand one may look at the uses to which the 
psychophysical methods have been put and say, “Does this add up to 
nothing?" What have the psychophysical methods allowed us to do? 
Binet used the method of constant stimuli as the means of arranging his 
items on an age scale in his test of intelligence. Whenever the Seashore 
Measures of Musical Talent is administered to a subject, it represents an 
experiment in the use of the same method. The lower limits of sensory 
sensitivity of man and animals were determined by the method of average 
error in some cases. All thresholds in sensory discrimination, whether 
absolute, terminal, or differential, were determined by either this method 
or the method of limits. The method of paired comparisons has come 
into great use in the field of advertising psychology and in the field of 
business where it is important to know how your products compare with 
your competitors’ in the eyes and appetites of the consumer. Cattell (3) 
used the method of rank order in his famous studies where he dealt with 
the scientific merit ranking of famous scientists, including astronomers 
and psychologists. In other instances, the ranking method has been of 
great value in attempts to find how much prejudice a certain group feels 
against other groups. This method has proved to be a quickly applied 
and easily understood psychophysical method for all types of situations. 
Its use has varied from rating employees to appraising public opinion in 
respect to the moving pictures put out by the film industry. Thurstone 
and Chave (0) used the method of equally appearing intervals in their 
now famous studies of attitude. 

It is impossible to think of measuring the preferences and opinions of 
human beings in ways exclusive of the psychophysical methods and still 
keep some semblance of scientific methodology in the attempt. An 
improvement upon the methods of psychophysics would be to find the 
neurophysiological correlates of judgment. This refinement is at the 
moment, unfortunately, only in the speculative stage. 

"Throughout this discussion of the psychophysical methods, there have 
been statements of the same tenor as the following: if the subject is pre- 
sented with two stimuli that are of the same class but differing in some 
characteristic and is instructed to divide the sense distance between the 
two stimuli into two, or perhaps even more, equal units, what stimuli 
serve to inform him that the point or points he has chosen is equal dis- 
tance between the two extremes of the stimuli? If the stimulus is one 
that can be measured in terms of some physical characteristic, then well 
and good, for we might say that he makes use of that characteristic as his 
stimulus for decision making. However, we do not know this, and are 
constantly cautioned by those who are skilled in interpreting the results 
of a psychophysical experiment not to forget that the stimulus has mean- 
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ing only in terms of the response it sets up in the subject. Thus these 
methods do not by themselves answer questions such as that posed above 
but only allow us to quantify a subject’s response in a given situation. 


Factorial and Functional Approaches as Methods of Procedure 


In Chaps. 4 and 6 reference was made to two levels of attack in any 
experimental situation. The first of these levels, the factorial approach, 
involves an attempt on the part of the experimenter to discover what 
condition or factor will cooperate with what other condition or factor to 
produce some desired result. То do this, only two values of the inde- 
pendent variable are used. These values are the presence compared to 
the absence of the independent variable as seen in the following example 


and in Fig. 6.4. 
Form taken by factorial approach: 


Phase I Phase II Phase ПТ 
Independent | Dependent variable meas- 
variable ured for each group so 
introduced | that the effect of the pres- 

ence compared to the 
absence of the independ- 
ent variable is demon- 
strated 


Experimental | Both groups equated in 
group terms of all known rele- 
vant factors 


Independent. 
variable 

not intro- 
duced 


Control group 


The factorial design is used most often in early, exploratory experiments. 
Such attempts yield results that tell you what conditions produce what 
results but do not tell you how these conditions are related. 

The functional approach is usually undertaken after one knows, through 
the outcome of an experiment performed under a factorial approach, that 
а certain condition produces a certain other condition. The functional 
approach involves choosing many, or at least several, different values of 
the independent variable as is shown in the following example and also 


in Fig. 6.3. 
Form taken by functional approach: 
Phase I Phase II Phase III 
Experimental | All groups equated | A different value of | Dependent variable meas- 
Eroups in terms of all the independent | uredforeachgroup. Re- 
known relevant variable is intro- lationship sought between 
factors duced to each ex- | different and specific 
perimental group values of independent 
variable and correspond- 
ing changes in perform- 
ance of dependent vari- 
ables 
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The results of an experiment performed under this approach yields 
information as to how variations in the independent variable are related 
to changes, if any, in the dependent variable. 

In the next few pages, we see the application of the factorial and/or 
functional approaches to typical experimental situations in the three 
broad subdivisions of the general area of learning: learning experiments, 
retention experiments, and transfer of training experiments. 


Factorial and Functional Approaches in Learning Experiments 


Learning is commonly defined as the change that takes place in an 
organism’s performance of a task as it continues to practice the task. 

Many factors are responsible for changes and differences in what we 
call learning in the individual. Some of these factors are part of the 
equipment possessed by the learner: motivation, age, sex, past experience, 
etc. Some of these factors are located in the method used in learning the 
material: logical memorizing compared with rote, amount of practice per- 
mitted, kind of practice, and distribution of practice, etc. Others of 
these factors are generated by the nature of the tasks to be learned: mean- 
ingfulness, amount, affective tone, etc. An experiment in learning 
involves the manipulation of at least one of the above factors. Both 
factorial and functional designs may be used in their ordinary sense when 
dealing with such problems. 

Below is the factorial approach used in learning experiments wherein 
some variable is introduced and its influence on learning ability is calculated. 


Phase I Phase II Phase III 
Experimental | Both groups equated in Independent| Presented with second 
group terms of some learning variable learning task (learning 
task similar to the one introduced | measured as dependent 
used in phase III variable) 


; 
Control group Independent | Presented with second 


variablenot| learning task (learning 
introduced | measured as dependent 
variable) 


The difference in the learning time, trials, and/or errors between the 
two groups in phase III yields an indication of the effect of the independ- 
ent, variable on the learning ability of the experimental group. 

A use of the functional approach in the same learning ability situation 
is as follows: 
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Phase I Phase II Phase III 
Experimental | All groups equated in | A different value of | All groups presented 
groups terms of all known the independent with the task to be 


learned; performance 
on this task is the 
dependent variable 
for each group 


variable is intro- 
duced to each experi- 
mental group 


relevant variables 


Factorial and Functional Approaches in Retention Experiments 

Retention is the persistency of a response, or the modification of a 
response, which may be produced some time after the learning episode. 
Retention depends upon all the factors discussed under Learning. A 
typical factorial approach to a retention experiment follows: 


Phase I Phase II Phase III Phase IV 
Experimental Both groups | Learns mate- | Independent | Retested on 
group equated in rial A to variable material A 
terms of criterion introduced 
Control all relevant 
Eroup factors Learns mate- |Independent | Retested on 


variable not material A 


introduced 


rial A to 
criterion 


In phase III, the independent variable introduced to the experimental 
Stroup may be any activity or stimulus whose effect on retention is being 
vestigated. The control group either rests or is given some task to per- 
form that has been demonstrated to have no effect on retention. The 
amount of retention of material A as a function of the interpolated activity 
її phase III is indicated by the difference between the two groups in 
respect to their respective performances on Test A in phase IV. 

A functional approach to a retention experiment follows: 


Phase I Phase II 


Phase III 


Experimental All groups equated in | A different value of | Retested on material 


the independent 
variable is intro- 
duced to each experi- 
mental group 


БТопрз terms of perform- 


ance on material A 


A. Performance on 
this retest is the 
dependent variable 
for each group 


Factorial and Functional Approaches in Transfer of Training Experiments 


Transfer of training occurs when the retention of a response previously 
earned has an effect on the learning of a new response. Thus transfer 
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may facilitate (positive transfer), inhibit (negative transfer), or not deter- 
mine (zero transfer) the acquisition of new material. 

A transfer of training experiment procedure under a factorial approach 
follows: 


Phase I Phase IT Phase III 


Experimental Both groups are tested on performance Training on | Test on task A 


group of task A and equated task B 
Control group Nonlearning | Test on task A 
activity 


The influence of learning В on the performance of task A is equal to the 
difference between the performance of the two groups in phase III. If 
the control group's results are subtracted from the experimental group's 
result in phase III and the correct sign (+ or —) is retained, the kind of 
transfer is ascertained. 


Savings Method 


One other method worthy of note used by investigators of memory phe- 
nomena is the savings method. This method differs from the others dis- 
cussed in that it is a method for calculating the savings involved in 
relearning, to the same criterion of mastery, previously learned but 
apparently forgotten material. The following formula proves adequate: 


original learning — relearning 
original learning 


Per cent of savings = 


If the measurement of performance is in terms of trials, errors, ог time, 
then the per cent of savings is in terms of the trials, errors, or time, 
respectively. An example would be: the subject originally learned to 
solve a maze in six trials. Four weeks later he relearned the maze, need- 
ing only three trials to reach the criterion. He learned under the same 
conditions each time. His per cent of savings in relearning the maze 
was (6 — 3)/6 = 50 per cent. See Woodworth (8, p. 9). 


Notes on Procedure 


In general, procedures are important because they set the stage for the 
experiment. It is under the heading of procedure that the experimente! 
describes the progression of acts to be performed by him during the collec" 
tion of the data. The procedure differs from the controls in that controls 
dictate the procedure. 

Simple variations of the procedures used in the psychophysical methods 
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and methods for dealing with learning, retention, and transfer, previously 
discussed, will suffice-to serve in most experiments the beginner will be 
undertaking. The tabular form of presentation of procedure using head- 
ings of phase I, phase II, ete., is useful but should always be supplemented 
by а more completely written description of the procedure. А good pro- 
cedure prospectus would cover such items as (a) the common name for the 
procedure used if it is standardized, i.e., method of average error, etc.; 
(b) a complete description of the acts to be performed by the experimenter, 
ie., a description of the equating procedure for the control and experi- 
mental groups, the method of introducing the independent variable to the 
experimental group and the treatment of the control group which is not 
presented with the independent variable, and the method of recording 
results; (c) discussion of the particular statistical technique to be used in 
dealing with the data; (d) a discussion of possible interpretations of the 
results which may be produced during the execution of the experiment, 
ùe., if the data support the hypothesis, what conclusions are justified in 
light of the procedure, or, if the data do not support the hypothesis what 
are the limits imposed on the interpretation of these data by the procedure 
used? 

Once the experimenter has progressed fr 
the series of steps involving the formation of 
of independent and dependent variables, and 
the description of the procedure, he must then st 
this research design he has evolved. All these ste 


with and exactly formulated before the researcher 
tory to collect data. If he stops and evaluates his procedure before he 


performs his experiment, he runs less risk of finding out too late that he 
forgot a control or had not anticipated a difficulty sure to arise in the 
collection of his data. 

Researchers sometimes design experiments in such a way that it is 
virtually impossible to apply an ordinary statistical technique. Some 
Statistical devices are usable only under certain conditions. The sophisti- 
cated experimenter solves this problem by the simple expedient of pre- 
Venting it from occurring. He selects the statistical technique to be used, 
Jirst, and then collects his data under а procedure which is most favorable 


for the use of the statistical technique. 
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CHAPTER 9 


METHODS OF INFERENCE 


{ presenting only one of the scientific meth- 


Although this book aims a 
__ Јев us take time out to look briefly at the 


ods—the experimental method 


other major methods available. 
There are several well-known scientific methods available for the 


psychologist to use. The investigator may find he is forced to use one 
rather than another because of the nature of the problem he is undertak- 
ing. The major methods available to him are, in order of increasing 
importance, (а) naturalistic observation, (b) statistical methods, and (c) 


experimental method. 


Naturalistic Observation 


Naturalistic observation is used if th 


must be studied as it occurs naturally. 
of competition in a society on its attitude toward war, it is obvious that 


the experiment should, and must, be conducted where the society exists 
and not in a “tiled wall” laboratory situation. In the same manner, it 
Would be impossible to study the prediction of attitudes and their altera- 
tion in a mob by attempting to create a mob made up of volunteer sub- 
jects. Even if one were to experiment with the members of a mob by 
Separately interviewing each member, we would not be able to uncover 
certain important aspects of the individual’s personality that are only 
revealed when the individual is stimulated by being part ofamob. Such 
problems must, because of their very nature, be studied where we find 
them, However, although we may find it necessary to go outside the 
typical laboratory setup and study the phenomena where they exist 
naturally, and without instigation by the experimenter, we must still take 
With us any experimental procedures applicable and utilize such experi- 
Mental methods as supplements to the method of naturalistic observation. 
In a broad sense, we would still be in a laboratory. Munn (9, p. 26) also 


Presents a discussion of this method. 


Statistical Methods 


Statistical methods are mathematical 


tain relationships, trends, differences, and 
89 


e subject matter of the problem 
If we wish to study the influence 


devices of use in discovering cer- 
probable predictions from pre- 
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viously collected data or findings. Statistical methods aid the experi- 
menter in uncovering facts that may not be immediately obvious in his 
mass of data. They aid him in deciding whether small differences 
between groups are large enough to be considered significant. They are 
basic to the development of norms of behavior by quantifying the tend- 
ency of a group, in respect to a certain trait, to cluster around a given 
point. Also, they help to quantify the variability of a group in respect 
to its possession of a given trait. 

The statistical methods must be looked upon not as experimental meth- 
ods but rather as tools of science which aid us in dealing with existing 
data. As was true in the method of naturalistic observation, the statisti- 
cal methods serve their most useful purpose when used in conjunction 
with the experimental method. See Munn (9, p. 36) for additional 
information on this method. 


Types of Experimental Designs 


Grouped under this title are the basic experimental designs man has 
for ascertaining facts by experimentation. We have previously indicated 
the need for man to deal directly with the things he wishes to understand. 
The methods about to be presented are logical devices that will enable the 
experimenter to set up research designs and to draw inferences directly 
from his data. In each method discussed we will find flaws which create 
the possibility for error in deciding just what has been demonstrated 
through the use of the method. Following the presentation of each 
method ‘will be a discussion of the validity of the method. 

Francis Bacon (1561-1626) was one of the first men to write about 
logical devices that could be used to aid the researcher in his search for 
scientific knowledge. Не did not feel that such rules would be many in 
number, difficult in application, or yield results capable of more than one 
interpretation. 

John Stuart Mill (1806-1873) undertook with enthusiasm the task of 
polishing the general concepts of Bacon and presented the logical 
devices as short rules under the title “ Methods of Experimental Inquiry. : 
Mill found he needed just five methods to cover all the types of logic? 
procedures required in establishing order among facts.! He stated these 
methods as five indicative canons. The canons were theoretically ai? 
tight, but so perfect that, in actuality, no experimenter could completely 
meet the requirements. The phraseology used in the statements has been 
difficult for the beginning student to comprehend quickly. For this rea" 
son, and for the further reason that Mill’s statement is more of historic? 
importance than it is of importance in teaching, the author wishes to usg 


1 Mill, John Stuart, A System of Logic, Vol. 1. 
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only the names of the canons as labeled by Mill and to proceed to treat 
the canons as they are used in modern context. However, credit is here 
given to Mill for the heavy contribution of his writings to the material 
presented in this chapter. 

If one were to go through the literature of science, and particularly that 
dealing with psychology, he would find only a few basic approaches used 
in experimentation. The particular research design in any one experi- 
ment might not be immediately obvious, but under close examination it 
would be discovered that an inductive procedure was involved which 
would (a) allow for the collection of data based upon a controlled observa- 
tion, (b) the method of collecting the data allowed the experimenter at 
the end of the experiment to relate the performance of one variable to 
that of another variable, and (c) the experimenter usually manipulated 
only one variable at a time in the experiment. As one reads one experi- 
ment after another, each time abstracting the three points mentioned 
above, he would in time, through generalization, build up a concept of the 
experimental method. The various types of approach used by the 
investigators would begin to fall into at least five basic categories. 
These types of application of the experimental method could be named so 
that each name described the manner in which the experiment was 
designed and conducted. Let us discuss these five types of research 
designs for conducting an experiment. 


Method of Difference 


The investigator proceeds as follows: 

1. He uses two groups of subjects equal in all respects. 

2. He “does something” to only one of these groups. That is, he 
Manipulates an independent variable in, or introduces an independent 
variable to, one of the tivo groups (experimental group) but does nothing 
to the other group (control group). | | 1 

3. If a change takes place in some dependent variable he is measuring 
in the experimental group, but does not take place in the control group, 
then he attributes that change to the independent variable he manipu- 
lated in the experimental group. | 

Тһе design is summed up by the following symbolic presentation: 


JKC — LME (experimental group) 
JK— LM (control group) 


therefore, C is related to the occurrence of Ё. н 
The experimentalist in psychology may make use of this method in the 

following manner: he may choose two groups of subjects and equate the 

two groups as well as he can in respect to all relevant variables. By 
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relevant variables is meant all the factors known to influence, to а measur- 
able extent, the phenomenon to be studied. Therefore the experimenter 
carefully sees that each of his two groups is composed of individuals hav- 
ing characteristics as similar as possible. Perhaps he knows that the age, 
intelligence, and sex of the subjects are capable of influencing the phe- 
nomenon to be studied. In that case he would make sure that the sub- 
jects were all of the same age, that the I.Q.’s of the individuals were the 
same, and that they were all of the same sex. He would then proceed to 
do something to only one of the groups, and would then measure the 
difference that exists in the two groups following the manipulation ef the 
one group. If a difference then existed between the two groups that did 
not exist before, he would be justified, according to the method of differ- 
ence, in assuming that whatever he did to the one group was associated 
with the change that took place in that group. 

The literature of the field of psychology is full of experiments performed 
under method of difference designs. Let us look at only one of these 
studies. Russell (10) used the method in an experiment aim at discover- 
ing the effects of mild anoxia on simple psychomotor and mental skills. 
In his study, 244 Army Air Corps Cadets were used as subjects and were 
divided into subgroups. "These subgroups were equated in terms of their 
initial performance on finger dexterity, arm-hand coordination, and sim- 
ple addition. These equating tests were administered under “ground” 
or normal oxygen supply conditions. One independent and three depend- 
ent variables were involved. The independent variable to which the 
experimental group was subjected was deprivation of oxygen occasioned 
by a high-altitude pressure chamber where the barometric pressure was 
reduced to simulate 18,000 feet altitude or anoxic (lack of normal amount 
of oxygen) conditions. The subjects were kept under the influence of the 
independent variable for 35 minutes during which time eight subsequent 
trials on the performance tasks were made. Thus performance on these 
tasks was the dependent variable. After the subjects had been “ brought 
down" to ground-level atmospherie conditions again, the performance 
tasks were administered under the same conditions as during the initial 
equating trials. The control group was treated in exactly the same man- 
ner except that these subjects were not exposed to the anoxic conditions. 
The results indicated an immediate drop in performance on the tasks bY 
the subjects under the influence of mild anoxia. More additional co? 
trols were instituted in this study than can be allotted space here. n 
addition, Russell drew further conclusions from his results. Howeve 
the study is presented here only to show the use of the method of differ- 
ence as it may be correctly applied. 

It is important to know the possible fallacies in the application of this 
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and the other methods. Therefore, under the discussion of each method, 
there will be a section discussing the favorable and unfavorable points. 
It is hoped that the reader will not look upon the criticisms as an attempt 
to damn the methods but rather as a critical analysis of the pitfalls into 
which the experimenter may fall as he applies the methods. 


Comments on the Method of Difference 


Unfavorable: What assumptions have we stated that may be fallacious? 

1. We specifically stated that the two groups of subjects are to be equal 
in all respects, i.e., they must be equated. Is this ever possible in psy- 
chology or any other science? How can one be sure, or even assume, that 
two peas in a pod are alike in all details? In the experiment mentioned 
above, the assumption was made that the subjects all had the same age, 
among other things. But did they, for were they all born at the same 
instant? You may say, “Yes, but you said the two groups needed to be 
alike in only relevant variables and just how important is it that all the 
subjects be born at precisely the same instant?" The answer is twofold. 
First, the method demands that they be absolutely of the same age. If 
We are going to adhere strictly to the method, we must follow this condi- 
tion. In addition, who am I to say arbitrarily what is a relevant variable 
and what is not? The only way I can establish relevance is by doing 
another experiment making use of this method. The method does not 
tell me what is relevant, and, thus, to discover relevant variables so that 
We can use the method we must use the method to discover relevant varia- 
bles. This just does not sound right to me. . 

2. This method is not a method of discovery. That is, it does not dis- 
cover previously unsuspected facts, because in the application of the 
method, it is necessary that the experimenter have a knowledge of all fac- 
tors that he manipulates. He has to have knowledge of what might be 
the cause before he can apply the method. He chooses his independent 
variable because he believes that it may be related to the dependent 
variable and not for any other reason. 

In the previous example cited, Russell believed that reduced oxygen sup- 
ply might be responsible for a decrement in the performance of simple psy- 
chomotor tasks and mental skills. His hypothesis was based on unverified 
observations that he had previously noted. His experiment that followed 
Was designed to put this hypothesis to a test for purposes of verification. 

3. The method is not a method of proof. So long as the cause of an 
event may be due to a multiple factor which loses its effect upon analysis, 
Or retains the effect in part if опу one element is present, then the method 
does not prove that one thing causes another. To show that a partial set 
of circumstances is related to the occurrence of a phenomenon is not the 
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same as proving that C causes Ё. You may discover what appears to be 
a factor related to the occurrence of a certain event only to find that when 
the factor alone is used as a cause the event does not appear. An example 
would be the discovery that adding a certain amount of high-test gasoline 
to regular fuel in your car yields better performance. You suggest the 
use of high-test gasoline to your friend only to find out that he does not 
report better performance. You then realize that the performance of 
your car is due to many factors, only one of which is the type of gasoline 
used. It is not just the gasoline that yields the performance of your car, 
or the setting of the air-gasoline mixture in your carburetor, or the size of 
your fuel pump, etc., but the interrelationship and combined operation 
of all these factors. Your application of the method of difference in this 
situation only gave you a partial answer and did not conclusively prove 
anything. 

Favorable: 1. The good of this method rests on the fact that it permits 
the use of a control group. An observation of the occurrence of a phe- 
nomenon, when an experimenter introduces a variable with an eye toward 
establishing a relationship, is meaningless unless he is certain that the 
phenomenon would not have occurred without the variable. 

2. Although the method is not a method of discovery, it does allow the 
experimenter to verify his hypothesis concerning the importance of his 
independent variable. 

3. Although the method is not a method of proof, it does allow the 
experimenter to reduce the area of possible explanation of a relationship 
to a point where a given factor can be evaluated in terms of its contribu- 
tion to the production of the phenomenon, 

4, This method justifies its use in experimentation, if only for the fact 
that it can serve as a tool of elimination. It can help an experimenter 
decide whether a given variable could not be the cause of a phenomenon 
when stated as follows: no variable can be the cause of a phenomenon if 
it is absent when the phenomenon occurs. 

5. The method has “worked” consistently in countless experiments, 
and much of the knowledge of the world as gathered by scientists depended 
upon its application and validity as a method of experimental, inquiry . 
There is no better approach to the investigation of problems, where this 
method applies, available to the scientist today. 

We might note here that a statistical procedure known as the ż test, dis- 
cussed later in this book, is usually used in conjunction with this method. 


Method of Agreement 


'The experimental situation in which this method applies would be set 
up as follows: 
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1. The investigator would observe two or more instances where the 
phenomenon occurs. 

2. Each time he observed the occurrence of the phenomenon, he would 
note specific independent variables present and the occurrence of specific 
dependent variables. 

3. He would continue to observe the occurrence of the phenomenon 
with different combinations of independent variables present until he 
ascertained that there was one and only one specific independent variable 
always present when a specific dependent variable occurred. 

4. He would infer that the independent variable that alone was com- 
mon to the occurrence of the specific dependent variable was the factor 
related to the occurrence of the dependent variable. 

We could symbolize this method by 


ABC — FGE 
BDC > СНЕ 
ADC —> ЕНЕ 


Therefore С is related to Ё. 

Let us see how the experimentalist might make use of this method. 
Suppose a psychologist were investigating the factors related to success in 
airplane pilot training, Case history records on 100 trainees, successful 
during training and later, revealed the fact that in all cases of successful 
Pilots there was one outstanding factor in common throughout the entire 
group: each man had at one time either owned or operated a motorcycle. 

һе psychologist might, if he were applying the method of agreement, 
State a relationship between the operation of motorcycles and success in 
Piloting airplanes. y Е 

The use of the method of agreement has been made іп many studies 
wherein it was extremely difficult to manipulate the presence or absence 
of an independent variable. Often such problems are encountered in 
dealing with the relative importance of heredity and environment on the 

veloping individual. Sometimes we control hereditary factors by 
using identical twins, or litter mates, and placing the subjects in different 
environments; we then attribute the similarities in the developing indi- 
Viduals to hereditary influences. It is much more difficult to hold the 
“vironment constant so that it may serve as an independent variable. 

П cases such as these mentioned, the method of agreement comes to play 
аз the type si n best fitted. E 

Kuo (6 nis papiro to determine whether heredity was 
lésponsible for the cat’s response to the rat. His procedure was, in part, 

5 Providing of different groups of kittens with different experiences in 
relation to rats and then checking to see if all the groups of kittens reacted 
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the same toward the rodents. If they did, he would then suspect that 
the hereditary background was responsible. If they reacted differently 
and in keeping with their respective experiences with the rodents, then he 
would expect the influence of the environmental contacts to have resulted 
in a learned response. The three different experiences given one to each 
of the three groups of cats were (a) each cat was reared in isolation from 
cats and mice, (b) each cat lived with its mother and was exposed to the 
situation of seeing her kill rats, and (c) each of the cats was raised in à 
cage with a rat. Data were gathered by giving cats from each group 
opportunities to kill rats from the time the cats were six to eight days old 
until they had either reached the age of four months or had killed a rat. 
Actually, the design was more complicated than reported here, but what 
is presented above is sufficient for our purpose. 

The situation might be symbolized as follows if heredity is responsible 
for the typical response of cats to rats: 


Isolation plus heredity — killing of rats 
Saw killing plus heredity — killing of rats 
Raised with rat plus heredity — killing of rats 


Actually, Kuo found that the killing of rats depended upon the experi- 
ence of the cat. The cats that had seen their mothers kill rats killed the 
most rats. The isolated group ranked second in rat killing. The cats 
that had been raised with rats killed the least rodents. The method of 
agreement allows us to say that the common factor of heredity was not 
related to the killing of rats to the extent that the environmental factors 
were. Thus the results support the hypothesis that the rat-killing 
behavior of cats is primarily acquired through learning. 


Comments on the Method of Agreement 


Unfavorable: 1. The correct use of this method demands that the two oF 
more occurrences of the phenomenon have only one circumstance in com- 
mon. In the first example of the application of this method which dealt 
with pilots, it is obvious that there were more common instances thar 
just experiences with motorcycles. Each of the pilot trainees had gone to 
high school, could speak and write English, wore a wrist watch, ate the 
same breakfast cereal each morning at mess, etc. You would have just 
as much reason to say that the possession of hair on their heads (sinc? 
none of the trainees was bald) caused their success as to attribute their 
success to any other common factor. Of course, there is à similarity 0? 
relevance between motorcycles and airplanes in that both have motor 
travel at high speeds, and may attract a more adventurous type of person 
But the method of agreement did not give the psychologist thisinforma" 
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tion. He already had an idea that such was true even before the experi- 
ment started. So the method itself only yielded evidence that was previ- 
ously suspected anyway. This is the reason the method of agreement is 
not correctly called a method of discovery. 

2. How many of the men who failed as pilots also had owned or oper- 
"rm motorcycles? The results of the experiment would be meaningless 
- Just as many men who had had experience with motorcycles passed as 

ailed. We see, therefore, that the method of agreement could use some 
E the characteristics of the method of difference if it is to aid in gathering 
acts, The next method to be discussed, the joint method, aids in over- 
coming this handicap to some extent. 

. 3. The method of agreement may cause the experimenter to incorrectly 
identify some factor as a cause. This example, often quoted, will show 
what is meant here. Jim drank the following, and with the indicated 
results, on three successive Saturday nights: 


1. Scotch and soda — inebriated 
2. Rye and soda — inebriated 
3. Bourbon and soda — inebriated 


By applying the method of agreement we arrive at the startling con- 
clusion that soda causes drunkenness. Of course, it is obvious in this 
example that alcohol was also a common factor. We can see that in a 
More complicated situation and one wherein we have little knowledge of 
all factors present, the wrong conclusion may be reached through the use 
of this method. 

Favorable: 1. The method allows the experimenter to develop hypoth- 
eses as to what could be the cause of a given event and provides a means 
of verifying his hypotheses by а systematic methodological approach. 

As the experimenter works in his laboratory, he may see a particular 
phenomenon oceur for which he has no ready explanation. However, 

rough keeping the method of agreement in mind he may watch for a 
Common circumstance always present when the phenomenon occurs. If 
t € discovers what he believes to be the common factor, then he may apply 
ü © method more rigorously in а more controlled experiment. Some- 
— after hypothesizing a certain factor to be responsible for the phe- 

menon, on the basis of the method of agreement, he turns to another 
Method, such as the method of difference, for additional evidence that the 


actor ; 
"Y 1s related to the phenomenon. - 
Ses The definition of this method is similar to the definition of the goal of 
Mie for they both aim at identifying а constant relationship between 
n е 
independent and a dependent variable. 


* The method, although not à method of proof or discovery in the 
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positive sense, does serve as a method of proof when stated in a negative 
sense. Thus, if a factor is not always present whenever a given phenome- 
non occurs, then that factor cannot be the only cause of the phenomenon. 


Joint Methods of Difference and Agreement 


This type of research design follows the procedure outlined below. 

1. The experimenter tests to see if two or more instances of the occur- 
rence of the phenomenon have only one factor in common. 

2. He then tests to see if, in two or more instances where that common 
factor is absent, the phenomenon does not occur. 

3. He concludes that since the only way the two situations differed was 
with regard to the presence and absence of one factor, then that factor is 
related to the occurrence of the phenomenon. A symbolic presentation 
of this would be: 

First Instance: 

ABC JKE 
DFC э LME 
GHC — NOE 

Second Instance: 

РО VW 

RS XY 

TU Za 
therefore C is related to E. 

An example of this method would be as follows: a psychologist is inter- 
ested in discovering the cause of temper tantrums in children. Не secures 
many case histories of children having temper tantrums and many case 
histories of children who have never demonstrated this type of behavior. 
In the first instance, the investigator would search for conditions common 
to the case histories of all the children having temper tantrums. In the 
second instance, he would find out how many of the factors present in the 
temper tantrum group are absent in the nontemper tantrum group. 
is doubtful whether he would be able to go much further in his interpreta- 
tion than to say that a certain relationship appears to exist between the 
presence of certain factors in the lives of the temper tantrum group а) 
the occurrence of the behavior and that the absence of these factors are 
related to an absence of the behavior. On the other hand each group ha 
many factors in common which have no relative importance in determin- 
ing the frequency of temper tantrums in children. 

Quite a few investigators have performed experiments involving th? 
removal of various parts of the cerebral cortex of rats and other laboratory 
animals in an attempt to evaluate localized areas of the cortex in term? 
of their contribution to learning, retention, sensory discrimination, €^ 
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Some of these studies have followed a type of methodology that most 
closely approximates the characteristics of the joint method of difference 
and agreement. One of these studies by Smith (11) dealt with an attempt 
to locate the cortical area most closely associated with tactile discrimina- 
tion in rats. The rats were given initial training in solving a Y-shaped, 
elevated-path apparatus. The rats were taught to select the arm of the Y 
which had been covered with sandpaper and avoid the pathway with a 
smooth surface. Surgery was then performed on the rats, and many 
lesions, involving most of the different parts of the cortex, were made. 
The animals were given postoperative training, the results of which were 
compared with the initial training results. Those animals who lost the 
habit after the operation were found to have a common site of lesion. 
These lesions were in the frontal and dorsal part of the brain. Smith then 
inferred that the tactile, or somaesthetic, function for the problem used in 
the study was localized in the frontal part of the rat’s brain. 
This type of design might be indicated for this problem as follows: 


First Instance: 

Animal A: Lesion; in frontal lobes — loss of tactile discrimination 
Animal B: Lesions in frontal lobes — loss of tactile discrimination 
Animal C: Lesion; in frontal lobes — loss of tactile discrimination 


Second Instance: 

Animal D: Lesion; outside frontal lobes — no loss of tactile discrimination 
Animal E: Lesion; outside frontal lobes — no loss of tactile discrimination 
Animal F: Lesion; outside frontal lobes — no loss of tactile discrimination 


Lesions in the frontal lobes are apparently more related to the loss of 
tactile discrimination than lesions outside the frontal lobes. ; The frontal 
lobes, then, are the most probable site of cortical localization of tactile 
discrimination, 

Comments on the Joint Method of Difference and Agreement 

Unfavorable: 1. It is doubtful whether two or more instances of a phe- 
nomenon can have only one circumstance incommon.' The experimenter 
Сап only attempt to accomplish this and hope he has overlooked no other 
Common circumstance present. 


2. The part of the statement which says “two or more instances where 


that common factor is absent” is misleading and in a sense meaningless. 
t would be very simple to find incidents not related to the phenomenon in 
Which the phenomenon does not occur. What is really meant is that the 
ative instance or instances where the phe 
€ 80 related to the phenomenon that there 1s а pos 
enon to occur, 


sibility for the phenom- 
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Favorable: 1. This method overcomes the objection to the use of the 
method of agreement alone, for the joint method deals not only with those 
instances of the occurrence of the phenomenon when the factor thought 
to be related to it is present, but also when the factor is absent. This 
introduces a control group into the situation. 

2. One of the greatest advantages of this method over the two previ- 
ously cited is that here we are by definition working with several instances 
of the phenomenon and, as such, are doing a group study. Only through 
the study of many individuals can we arrive at a level where we may be 
confident of our results. If we knew all the factors involved, then we 
could speak in terms of certainty, but since we seldom attain this, we must 
be satisfied with results in terms of probability. Using a method which 
deals with several rather than only two instances is a step in the right 
direction. 

3. The demand that the two instances differ with respect to only one 
factor is impossible to meet. It is only an ideal condition to be hoped 
= and not the practical situation with which the experimenter usually 

eals. 


Method of Concomitant Variation 


It is to be noted that the three previously discussed methods treat only 
of the presence or absence of a phenomenon. These methods aid in ascer- 
taining whether a difference exists in a phenomenon due to the presence 
or absence of a factor. Such methods are used in experiments known 89 
factorial experiments. Factorial experiments are usually of the explora- 
tory type and tell you what occurs when you introduce a factor. After the 
experimenter has shown that the presence or absence of a factor is related 
to the presence or absence of the phenomenon, he is ready to launch into 
experiments aimed at discovering how variations in the amount of the fac- 
tor are related to corresponding changes, if any, in the phenomenon. 
Such experiments are typed as functional experiments. 'The method of 
concomitant variation is basic to functional-type experiments. 

'The usual application of this method involves the following: 

1. An independent variable is varied in some systematic manner. 

2. A dependent variable is measured in the presence of this varying 
independent variable. р 

3. The experimenter records the variation of both the independ 
variable and the dependent variable. 

4, If the dependent variable varies in any manner whenever the inde- 
pendent variable varies in some particular manner, then the experimente" 
concludes that the two variables are related. 

This method expressed symbolically is 


ent 
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ab (1C) > df (1E) 
ab (2C) — df (2B) 
ab (3C) df (3E) 
ab (4C) — df (4E) 
ab (8C) — df (BE) 


therefore C is related to E or is connected with it through some fact of 
causation. 

À typical use of this method follows: an experimentalist was interested 
in discovering what relationship existed between the number of years of 
Schooling completed by employees in an industrial concern and their 
efficiency ratings as judged by their immediate superiors. He discovered 
that there was a positive relationship between his two measures on each 
employee, indicating that the employees with the greatest number of years 
of schooling were rated highest in efficiency. The investigator advised 
the personnel office to hire the applicants having the most schooling. In 
this example we see the type of concomitant variation wherein as one fac- 
tor is increased another increases with it. This type and others are pre- 
Sented below symbolically to show complete ramifications of the method. 
Only Types I and III are actually exclusive. 


Type І: ct Eft 

Type II: Ci Et (reverse of I) 

Type II: C! EY 

Ту Iv: C} Ef! (reverse of IIT) 

TypeV: C fU EU (combination of I and IT) 
Typ VI: cM EW (reverse of V) 


_ Туре III serves to describe the events in an experiment such as the 
vestigation of the size of the pupil of the eye as compared to the amount 
of illumination to which the eye is exposed. Here we see that as the 
tensity of the light increases, the size of the pupil decreases. | 
Curtis (3), at Princeton University їп 1943, attempted to establish the 
relationship Mensen hypnotic susceptibility and intelligence by means 
|. * Method of concomitant variation design. The experiment resulted 
from an attempt to resolve conflicting evidence in the literature which 
reported to favor in one instance a positive relationship between suscepti- 
bility to hypnosis and intelligence (5) and in another instance to indicate 
= relationship (4). To establish the intellectual level of the 32 subjects, 


í 9 ranged from a chronological age of sixteen to thirty-two, the Stan- 
9rd-Binet Intelligence Scale was administered prior to the application of 
Pnotic susceptibility scale. A control was instituted to prevent 
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experimenter bias in the application of the hypnosis susceptibility scale. 
After the administration of the intelligence scale, each subject was scored 
in terms of the hypnosis susceptibility scale which gave a higher numerical 
score for those subjects who responded most to various levels of suggestion 
given. Thesuggestions varied from simple eyelid closure through increas- 
ing degrees of response to a posthypnotic suggestion of reinduction of 
hypnosis 5 minutes after the subject awoke from the original trance. The 
data collected consisted of paired scores on each subject, a hypnosis sus- 
ceptibility score, and an intelligence quotient. The investigator found a 
significant positive relationship between the two sets of scores that could 
only remotely be attributed to chance. Thus, there appears to be à 
strong indication that the more intelligent individuals in the study were 
more susceptible to suggestions given under hypnosis. 


Comments on the Method of Concomitant Variation 


Unfavorable: 1. The statement might be made that age varies Con- 
comitantly with the number of words in a person’s vocabulary due to the 
fact that such a relationship has been found to exist in an experiment per- 
formed under the conditions of the method of concomitant variation. 
But can age be the cause of anything? Age is like time, it is only a suc- 
cession of events. Thus age, per se, can cause nothing to happen. The 
real cause is, instead, the events that have occurred during the passage of 
time called age. The experiment did not yield any useful evidence as to 
the cause of the acquisition of words as age increases. Plainly, this 
method did not ferret out in this case the cause of the phenomenon. 
only allowed the experimenter to secure supporting evidence for a causa 
connection already suspected. 

2. The investigator finds in an experiment, and most often does In 
psychological experiments, the condition wherein the relationship of one 
variable that varies concomitantly with another variable holds only over 
a particular range of intensity of the precipitating factor. For instances 
he may find by applying this method to the problem of age compare 
with strength of grip that as a child grows into manhood there is & direc 
increase of strength of grip with age. But if he carries the experimen 
into later life, he finds the age continuing to increase and the strength 9 
grip reversing its direction and decreasing. Thus what holds true for ОР 
range of a continuum may not hold true for another. | 

3. In the example under (2), the experimentalist has just as muc? 
reason for concluding that strength of grip causes age as to conclude age 
is a cause of strength of grip. But the former statement is ridiculous, 
Yes, but how is this made known by the bare application of the metho E 
The point is, the method does not tell which is the cause and which i$ ! a 
effect any more than do the rest of the canons. Additional informat! 


t on 
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is needed, therefore, to interpret the results of experiments performed 
under this and the other methods. 

4. Discovering that two variables vary in a constant relationship with 
one another is no proof that they are related in a cause-and-effect relation- 
ship. One might easily find two variables whose variations are appar- 
ently related quantitatively but which are almost certainly not related in 
any cause and effect manner. For instance, if one discovered that the 
birth rate of Eskimos increased and decreased as the price of cotton in the 
southern part of the United States increased and decreased, he would 
doubt if the relationship were any more than a chance one, devoid of 
cause and effect implications. However, if he also observed that as the 
Price of cotton increased, the number of lynchings of Negroes in the South 
decreased, and vice versa, then he might logically suspect a cause-and- 
effect relationship. One must make certain that there is a logical con- 
nection between two events that vary concomitantly before he may draw 
causal connections, However, most rigid experimentalists will deny that 
there are independent or dependent variables in correlated events—or 
even any basis for causal connections. 

Favorable: 1. The method allows the experimenter to do easily the 
thing he wants most, ie, to establish relationships between variables. 
By repeating observations many times and using the method of con- 
Comitant variation intelligently in securing data, he would collect scien- 
tific information of considerable usefulness and reliability. 

2. The method of concomitant variation suggests cause-and-effect: 
relationships only when a sufficient degree of correspondence is present in 
the variations of the factors involved. If the factors vary without any 
More than a chance relationship with each other, then no cause-and-effect, 
relationship is suspected. 

3. This method is a method of proo 
can be the cause of a phenomenon which 
when the phenomenon varies. ү ' 

We should note here that the statistical technique known as correlation 
is most useful in dealing with data collected under the method of con- 
COmitant variation. The use of correlational techniques in relation to 
his method is discussed later on in this book. 


{ when stated negatively: nothing 
does not quantitatively vary 


Method of Residue 


Briefly stated, this method involves 
ae The investigator first attempts to ¢ 
‘on and deduction, that specific and i 
Present in a phenomenon are due to the e 


Idepend, р 
ent variables. т ! у . 
He continues to ascertain such information until the relationship 


the following steps: 

determine, through experimenta- 
dentifiable dependent variables 
ffects of specific and identifiable 


104 INTRODUCTION TO EXPERIMENTAL METHOD 


between only one dependent variable and one independent variable yet 
remains unknown in the situation. 

3. He infers that this remaining dependent variable is related to the 
remaining independent variable. 

Stated symbolically, if it is known that A causes B, D causes F, and G 
causes H in the paradigm ADGC — BFHE, and that there is yet only C 
and E remaining, then the statement which follows can be made: 


AB 
DF (known) 
Go Н 


CE (inferred) 


Therefore C is related to E. 

Using a method of residue design through the technique of sensory 
elimination, Watson (13), in 1907, reported that his rats were not seriously 
handicapped in solving a maze habit, although he both successively and 
simultaneously removed various sensory cues by blinding, deafening, 
removing vibrissae, and anesthetizing the soles of the rats’ feet. Appar- 
ently, the rats, in solving the maze, could only use the remaining senses, 
namely, kinesthetic (which provides cues from the muscles) and organie 
sensitivity—the residue. Such results, as typical of those secured through 
the use of the method of residue, give only negative evidence. The ques- 
tion still remains, “What are the processes which are responsible for the 
rats solving the тале?” 

Lashley and Ball (8), dissatisfied with Watson’s interpretation of his 
data, performed an experiment aimed at partially eliminating the kines- 
thetic sensitivity of the animals. If the rats could not run the maze as 
well after partial elimination of kinesthesis as before, then they believed 
that Watson’s interpretation of the importance of kinesthesis would be 
correct. However, if the rats could learn the maze as well with partia 
destruction of kinesthesis as they could with no destruction, then Watson 
could be wrong. Lashley and Ball first trained their animals to solve à 
maze under the condition of an elimination of cues for vision, touch, smell, 
and hearing. Experimental animals had their kinesthetic senses impaire 
by surgery. Some operated animals, when later returned to the mazes 
solved the maze without making a significant amount of errors. Contro 
animals continued to use kinesthetic cues to solve the maze. 

What does this leave for the rat to use as cue material in solving à 12276 
The best thinking at present concerning this problem is that the rats form 
a “cognitive map" as Tolman (12) has explained such reactions. The 
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rat may have developed a general pattern or “brain picture.” А general 
movement orientation to the goal can be built up in the nervous system of 
the animal even when no sensory cues of direction are present. This, 
then, is the residue of the residue. 


Comments on the Method of Residues 


Unfavorable: 1. The question remains, however, “What if the animal 
still has another sense organ remaining besides the kinesthetic, this other 
remaining sense organ being unknown to the experimenter?” This 
method, then, as in the case of the others, requires that the experimenter 
have knowledge as to where to look for the cause. In addition, he must 
know that he has overlooked no factor that could be the cause. 

2. The cause must be clear-cut and not part of a complex factor whose 
mutual interaction is responsible for this cause. If a phenomenon is 
caused by such a complex factor whose force as a causative agent dis- 
appears when one after another of its elements is eliminated, then the 
method of residue does not apply. 

Favorable: 1. This method allows one by a process of elimination to 
approximate with greater and greater accuracy the area within which the 
cause of the phenomenon rests. Its greatest use is as a tool of elimina- 
tion, where so stated it would become: those factors which may be 
Temoved from an experimental situation without eliminating the occur- 
Tence of a phenomenon cannot be the cause of the phenomenon. 

Experimenters who base their designs on these five methods do so fully 
aware of the fallacies of the methods. Because they are forewarned, they 
are forearmed. Such methods allow the experimenter to establish rela- 
tionships among variables. Such methods allow the experimenter to 
eliminate false hypotheses and thus narrow to a great extent the area 
Wherein the truth lies, Such methods allow us to describe restricted 
Conditions which will probably produce an effect time and time again. 
This is all the scientist can do in ascertaining cause and effect. Perhaps 
It is enough, for everything that we now know as a fact resulting from 
observation and experiment, whether true or false, was discovered by the 
Use of one or another of these methods. Statistics will show us how to 
quantify our level of certainty through the use of probability theory. 
Statistics will help us to accept or reject information gathered through the 
use of these methods. The use of the correct statistical tools in addition 
to the use of the correct method of experimental inquiry is a “must” for 
Satisfactory research. і . , 

Cohen and Nagel (2) and Larrabee (7) have direct discussions of the 

Ve inductive methods of experimental inquiry discussed above. Their 
treatments deal with the canons as originally stated by Mill. Andrews 
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(1) and Woodworth (14) offer discussions relevant to the application of 
several of these methods. 
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CHAPTER 10 


APPARATUS 


The development of apparatus for use in psychological experiments 
has been important to modern psychology. During the latter part of the 
last century and the first part of the present century a peak was reached 
in the invention of instruments for use in experiments. Many of these 
pieces of apparatus were developed, or at least constructed, in Germany 
and were finely made of the best materials, usually brass. The use of 
such apparatus in psychological experiments gave the early experimental 
laboratories the air of a physics laboratory with all its assurance of being 
а science. Psychologists who used such apparatus in their experiments 
were sometimes facetiously spoken of as “brass instrument psychologists.” 
Sometimes this title was applied in the absence of good humor. 

_ As psychology progressed along stimulus-response, or behavioristie, 
lines, more apparatus was developed to fill the existing needs. In general, 
Such apparatus was designed to do two jobs: First, to present, system- 
atically, controlled stimuli, and, second, to measure behavior accurately 
following the presentation of stimuli. Actually, the need for control of 
4n experimental situation is the mother of most psychological apparatus 
Mventions. If a light, sound, or other stimulus source is to be controlled, 
Some type of apparatus must be used. Likewise, the measurement of the 
Tesponse of the subject to the stimulus can best be reliably measured by 
Some objective means involving apparatus. But some apparatus used by 
Psychologists are not brass instruments or of electrical or mechanical 
nature. Paper-and-pencil tests, such as an intelligence test, are also 
Apparatus, One may look at the administration of an intelligence test 
asa situation where the subject’s intelligence is the antecedent, his intel- 
igence quotient is the consequence, the standardized procedure of 
administering the test is the means of controlling the situation, and the 


test itself is the apparatus. 


" A good piece of apparatus should have sever tant 
ISties: (a) it should measure accurately and consistently within the г 


Where the stimulus or response is produced, (b) it should not itself produce 
Pi effect that would obscure or alter the event being investigated, and 
©) ìt should provide a means of collecting, automatically, if possible, an 


o 1 
Jective, permanent record (1). 


ral important character- 
ange 
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During the course of an experiment, particularly if data are gathered 
over a long period of time, the apparatus used should be routinely checked 
for efficiency of operation by recalibrating it in terms of some criterion. 
This is particularly important when two supposedly identical pieces of 
apparatus are being used, one for the experimental group and one for the 
control group. It is obvious that changes in the performance of one of 
the pieces of apparatus could be the cause of a difference in the results 
between the two groups and mistakenly interpreted as a difference due to 
the independent variable under investigation. 


List of Apparatus Used by Psychologists 


A list of the apparatus most often used in psychological experiments (2) 
follows. The apparatus listed was chosen for inclusion here because each 
piece is mentioned in at least one or more good general or experimental 
textbooks. The best definition or picture in the world would not help fix 
in the student’s mind a concept of the apparatus defined as well as would 
a brief personal contact with the apparatus, The student should attempt 
to examine each type of apparatus mentioned and, if possible, have its 
function demonstrated for him. 


Activity cage. A cage which records the gross movement of its occupant by 
having each movement of the cage contact or vary a marking device. 

Activity wheel. A cage built in the shape of a wheel and rotated by the activity 
of the animal as it climbs the inside of the outer rim. 

Aesthesiometer. An instrument (often in the form of calipers) which has БУО 
rounded points capable of being varied at different distances from each other. 
It is used in the determination of the two-point threshold and other skin-sensi- 
tivity experiments (see Fig. 10.1). 


Fic. 10.1. Aesthesiometer. (С. Н. Stoelting Company, Chicago.) 


Ataxiameter. Measures the amount of “sway” of a person who is attemptin£ і 
to stand motionless. 


Audiometer. Measures the intensity threshold and range of hearing of 9? 
individual. 

Automatograph. Measures the undirected movements of an individual. d 
Jastrow automatograph records the movement of an individual's hand а8 ! 
rests on a sheet of glass supported by three ball bearings. 
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Barany chair. А rotating chair on which an individual sits and is spun around 
in a vertical plane. Used to stimulate receptors of bodily motion. 

Beat-frequency oscillator. Ап electronic apparatus which beats two frequencies 
together producing a third tone. Various controlled frequencies and intensities 
of sound are produced. 

Bell Adjustment Inventory. Paper-and-pencil personal adjustment question- 
naire which purports to measure adjustment in the areas of home, health, social, 
emotional, occupational, and total. 

Chronoscope. An instrument for measuring duration of time, usually gradu- 
ated into hundredths of a second or less, and equipped with a clutch mechanism 
80 that time elapsed between a start and stop is measured and accumulated. 

Color wheel. A disk having various colors as sectors and rotated at a high 


Speed to produce color mixture (see Fig. 10.2). 


Fia. 10.2. Color wheel. (C. Н. Stoelting Company, Chicago.) 
Conditioning unit. An apparatus used to present an unconditioned and a 
Conditioned stimulus simultaneously so as to produce a conditioned response 
(see Fig. 10.3). T" Я 
Depth-perception box. An elongated box containing two movable upright poles 
With strings attached to them. The subject attempts to align the poles so that 
ey are each equal distant from him (see Fig. 10.4). — | а р 
Yynamometer, An instrument containing а hand a p when squeeze 
*ecords the str i individual (see Fig. 10.5). 
ength of grip of the indiv : | | 
lectrocardiograph. ‘An electronic instrument used in recording the electrical 
Activity of the heart muscles. 
i lectromyograph. An electronic instrument us 
"пзу, and duration of the activity of a muscle. 


ed in recording the frequency, 
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Electrostimulator. A device used to deliver an electrical stimulus. Usually, 
it highly controls the frequency, intensity, and duration of the electrical stimulus 


delivered. 


eS. 2 


Fic. 10.3. Conditioning unit. (С. Н. Stoelting Company, Chicago.) 


Fic. 10.4. Depth-perception box. (С. Н. Stoelting Company, Chicago.) 


Episcotister. A rotating disk having open sectors. Used to regulate the 
intensity of light emanating from a source, and to present short exposures 0 
visual materjal. 

Ergograph. A device utilized in the study of change in muscular contractio” 
under conditions of work and fatigue. Usually only the muscle group e 
investigated is free; all other related muscle groups are immobilized. 
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Eye-movement camera. An instrument which projects small beams of light on 
the subject’s cornea. The light reflected is focused onto a moving strip of film. 
As the eyeball turns in a horizontal plane, as in reading, the searching movements 
of the scanning eyes are recorded. 


Fic. 10.5. Бузар, (С. Н. Stoelting Company, Chicago.) 


Eye perimeter. An instrument consisting of a quadrant which rotates on an 
axis, The subject fixates at the center of the quadrant’s rotation. M ve 
Visual stimuli, usually colors, are moved along the quadrant as the subjec 
Attempts identification. In this manner the retinal field is mapped. 


‚ Galton bar, An apparatus used 
in demonstrations of psychophysics. 
216 subject is to move a white strip 
in and out of a black tube by means 
Y a lever until it is equal in length 
© а standard white strip of a pre- 
ee set length extending from the 
er end of the black tube. 
alton whistle. Aninstrument used 
ii Produce high-frequency sounds. 
ish. "Ser squeezes a small bulb at- 
F "ed to a tube whose length is 
ned by means of a screw piston. 
in M Screw is graduated and roughly | - nes 
Cates the frequency of the sound ра. 10.6. Galton whistle. (C. Н. Stoelt- 
Produced (see Fig. 10.6). ing Company, Chicago.) 
€aly puzzi ith one _ ^ 
made of rims S ide: attempts to open the box by releasing a series 


Bide 
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of strings and rings inside. His only tool is a buttonhook which is introduced 
into the box through a hole (see Fig. 10.7). | 

Impulse counter. Ап electrical instrument which records on a mechanical 
revolution counter each discrete impulse delivered to it. A prolonged stimulus 
will record only once in that the counter records how many impulses are delivered 
but ignores the duration of the impulses. Each time an electric circuit is made 
and broken, one impulse is recorded on the counter. 


Fic. 10.7. Healy puzzle box. (C. Н. Stoelting Company, Chicago.) 
Ishihara test. A test for color-blindness. It consists of a number of plates 
having a circular patch made up of color dots of various sizes, hues, and intensi- 
ties. Numbers are seen in the pattern of dots, and their identification reve? Е 
whether the subject is capable of discriminating among the hues (see Fig. 10. 
for a color-blindness test). А 

Koenig bars. Steel bars of various lengths, suspended by strings, which yield 
sounds of various frequencies when struck with a hammer at their mid-points- 

Kuder Preference Record. A questionnaire used to determine the preference 
of an individual for various vocational areas. Norms are provided for men ap 
women in the areas of outdoor, mechanical, computational, scientific, persuasive 
artistic, literary, musical, social sciences, and clerical. A validity score 
achieved for each person’s answers. 

Kwalwasser-Dykema. А test of musical aptitude. It consists of five p? fier" 
graph records which are played for the subject. The subject must make di al 
ence discriminations in the areas of quality, tonal memory, feelings ап es 
movement, intensity, rhythm, time, pitch, melodie taste, rhythm imagery: 


pitch imagery. 


phon? 
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Fic. 10.8.  Color-blindness test. 


к Eumograph. Used to reeord changes in 
SN during a passage of time. It is a 
Siok drum covered with graph paper (or 
ing ed) and has in contact with it a writ- 
Baie (or stylus) which moves at right 
drum. to the direction of rotation of the 
rubber The pen is usually fastened to а 
ети tambour or an electromagnet to 
тебер, is delivered the response effect to be 
ed (see Fig. 10.9). 
on drum. A motor-driven drum 
earni bs the presentation of materials in 
on “We не, The material typed 
around rip of paper which in turn 1s fastened 
drum t the outside of the drum. Аз the 
is seen Р ns at a selected speed, the material 
appar hrough a slot in the case housing the 
Mats (see Fig. 10.10). 

Siig, tracing board. An apparatus Con- 
inches of a small mirror, usually 6 by 8 
ў "- mounted on a flexible joint so that 
on reflect the image of a design fastened 
tached, board to which the mirror is at- 

* The subject attempts to trace 


(C. Н. Stoelting Company, Chicago.) 


the intensity and frequency of a 


Fic. 10.9. Kymograph. (C. H. 
Stoelting Company, Chicago.) 
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Гіс. 10.10. Memory drum. (С. Н. Stoelting Company, Chicago.) 


the design accurately on the board while viewing it in the mirror (see 
Fig. 10.11). 


Fic. 10.11. Mirror tracing board. (С. Н. Stoelting Company, Chicago-) 


Müller-Lyer illusion. Two lines of exactly the same length but appearing 


unequal because one line has arrowheads at its ends and the other has агг 
tails at its ends. 

Multiple-choice apparatus (Yerkes). The subject is presented with 2 number 
of stimuli at once, such as lights or doors, and must “discover” certain атта 
ments, preset by the experimenter, in order to give a correct response. ii 
* third light or door from the right" may be the right response or the «midd! 
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light or door may be the key regardless of how many lights or doors are presented 
on various trials (see Fig. 10.12). 

Multiple-T maze. А spatial maze whose pathways are composed of a number 
of T’s combined into a continuous pattern. 
\ Obstruction box (Columbia). Apparatus used to measure the strength of drives 
in animals. It consists of two cages separated by an electrified grid. The 
animal is placed in one cage and its reward (a mate, food, water, litter) placed 


Fre, 10.12. Multiple-choice apparatus by Yerkes. (C. H. Stoelting Company, 
Chicago.) 


In the other cage. The number of crossings of the animal ina 20-minute period 
18 a reliable test of the strength of the animal’s particular drive. бм 
h "Conner F inger Dexterity Test. The test consists of a block containing 100 
oles into each of which the subject must manually insert three small metal 
pins. The amount of time required to fill all holes is then converted into a 
Percentile rank. 
onner Tweezer Dexterity Test. t 
o Into each of which the subject must insert, b 
Small meta] pin. The amount of time require 


Verted int ; j 13 
© a percentile rank (see Fig. 10.13). et ее" 
нц An instrument used in psychophysical investigations gap 


Sense of g ; ; f t lass tubes curved to fit the 
. smell T , essentially, of two glass 
Nostrils, and vidit bur ink a shield. The distal ends of the tubes are 


The test consists of a block containing 100 
y means of a pair of tweezers, 


holes 
d to fill all holes is then con- 
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fitted into larger tubes lined with odorous substances and which can be extended 
to any desired length. 

One-way vision screen. Used to permit the experimenter to observe the subject 
without in turn being observed himself. A one-way mirror may be used. A 
second, and very simple, setup consists of the subject being placed in a closely 
woven, black screen cage. Bright light inside the cage and darkness outside 
allow the experimenter to see in the cage but prevents the subject from seeing out. 

Oscilloscope. An electronic instrument having as its major component a 
cathode-ray tube. Alternating voltages, such as those produced by sound acti- 
vating a microphone, cause an electron stream to deviate proportionally and to 


Fic. 10.13. O'Conner Tweezer Dexterity Test. (C. H. Stoelting Company, Chicago-) 


trace a wave pattern on the end of the cathode-ray tube which appears to the 
observer as a sereen. 

Photometer. An instrument used to measure the brilliance of light in terms of 
candlepower. 

Plethysmograph. Measures changes in size of parts of the body due to alter 
tion of blood supply. It consists of a closed cylinder filled with water into whic 
is extended the member. Changes in size of the part of the body enclose 
causes a change in the level of the water which in turn varies a column of 2 
a tube extending from the cylinder to a tambour recording device. ; 

Pneumograph. Used to record the breathing rate of a subject. It consist? 
of a flexible and stretchable rubber tube closed at one end and having the other 
end connected by a hose to a tambour recording device. The apparatus | 
fastened snugly around the subject’s chest or diaphragm (see Fig. 10.14). 

Polygraph. A kymograph-type revolving drum which provides for the 
taneous recording of several physiological processes (see Fig. 10.15). 

Problem box. A problem situation for animals where the animal mu 
to move levers or pull string, etc., to get in or out of a box in order to Г010 
reward. 


jr in 


simul 


st Jen? 
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Fic. 10.14. Pneumograph. (С. Н. Stoelting Company, Chicago.) 


Fic. 10.15. Polygraph. (C. Н. Stoelting Company, Chicago.) 
Pse 

right or ePhone. An instrument used to carry sounds, whose source is to the 
ites i individual, to the left ear, and vice versa. It consists of two receiving 
i 2—8 equipped with tubes bent to go around the individual’s head and fit 


into 
is ear i 
ears (see Fig. 10.16). 
easurement of the changes 


Sych s 
ski ogalvanometer, An instrument used in the m 
1 on the surface of the skin 


n 
(вов Ti 


7 
Pillometer - An instrument used to measure the size of the pupil of the eye. 
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Le X = жг. ааз теак ek] 
Fra. 10.16. Pseudophone. (С. Н. Stoelting Company, Chicago.) 


(С. Н. Stoelting Company, Chicago? 


Fie. 10.17. Psychogalvanometer. 


08 

It consists of a telescope type of arrangement equipped with adjustable 5 
hairs. "m 

Pursuit meter. A revolving disk such as a phonograph turntable havin ә 
metal spot on its surface near the outer edge. The subject attempts tO 
stylus in contact with the spot as the disk rotates. pro 

Reaction-time apparatus. An apparatus consisting of two switches, 2 A 
scope, and a light or sound source in series. The subject closes one 


npo” 
the 
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Tra а — a Li, a "ue 
"ra. 10.18.  Reaction-time apparatus. (C. Н. Stoelting Company, Chicago.) 


Fig, 
10.19. Part of Revised Stanford-Binet Intelligence Test. (C. H. Stoelting 


Co 
"рату, Chic ago.) 


Swi 
n tehes a staggered time interval following, 
М thus tur The stimulus and chronoscope are 
stimul; i il the subject is able to react to the 
chronoscope (see Fig. 10.18). 
] intellectual development achieved 


9р; opens the circuit stopping the 
| by an in Stanford-Binet. A test of general 
ividual (see part of test in Fig. 10.19). 
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Rorschach Test. A personality test used in the diagnosis of personality. It 
consists of ten cards containing ink blots, five of the cards being black and white 
and five containing colors. The subject tells what he “sees” in the cards and 
in this way reveals his personality through the mechanism of projection. 

Seashore measures of musical talent. By using phonograph records as the 
means of presentation, various musical capacities of the individual are measured. 
The materials present tests for tonal memory, pitch discrimination, intensity, 
time, rhythm, timbre, and consonance. 


Fic. 10.20. Sphygmograph. (C. Н. Stoelting Company, Chicago.) 


Singerman color-mixture apparatus. Consists of a box inside of which is a 
light source that illuminates a milk-glass screen. Red, green, and blue filters 
may be adjusted to overlap. The overlapping of red and blue produces purple; 
green and red produces yellow; and green and blue produces blue-green. 

Skinner box. A type of problem box where the animal is automatically 
delivered a pellet of food each time it presses a lever. 

Sound perimeter, An apparatus used in sound-source localization experi- 
ments. It consists of a fixed chair upon which the subject sits, a movable sound 
source (usually a buzzer mounted on one end of a stick five feet long and a push 
button on the other end), and a large, circular azimuth indicator which can be 
moved in horizontal-vertical planes. 

Spectrometer. An instrument used in the study of color. It is capable of 
analyzing white light into its separate wavelengths. 

Sphygmograph. An instrument used in measuring the rate and force of the 
pulse. It consists of a device which is attached to the wrist. Each pulse beat 
causes a lever to move and activate a tambour attached to a polygraph (see 
Fig. 10.20). 
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Sphygmomanometer. Ап instrument used to measure arterial blood pressure. 
It consists of a rubber cuff which is inflated around the subject’s upper arm and 
а mercury column used to indicate the pressure of the cuff at the point where the 
pulse ceases. 

Stabilimeter. A cage or а bed so suspended or supported that it is moved by 
movements of its occupants. These movements of the cage are recorded by a 


pneumatic, electrical, or mechanical system. 
Steadiness tester. Used to test the hand steadiness of subjects. It consists 


‘of a metal plate containing apertures of various diameters, а metal stylus, and 


E 


Fic. 10.21. Steadiness tester. (C. Н. Stoelting Company, Chicago.) 


а chronoscope or impulse counter. All are connected in series with a battery. 
Each time the stylus makes contact with the aperture plate the circuit is closed, 
causing the chronoscope ог counter to record. The steadiness score is the 
accumulation of recorded contacts made (see Fig. 10.21). : 

Stereoscope. An optical instrument used in studies of depth райо, It 
consists of a pair of prisms so arranged that each displaces a picture presentec ү 
each eye. Thus two pictures taken from slightly different angles are combine 
and the illusion of depth is perceived in the picture (see Fig. 10.22). 


Strong Vocational I nterest Blank. An inventory which purports to measure the 


interest a subject has in various types of vocations. Scales are available for all 


the maj ions and vocations. . 

vn кр = test of the projective type. It consists of six ty 
of eight pictures. In each set are pictures of persons who were ba. ne M 
having mental disorders. The testee sorts the pietures into those he li S a 
dislikes. Тһе results are profiled in terms of eight factors: homosexual, sadistic, 


epileptic, hysteric, catatonic, paranoid, depressive, and manic. 
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Tachistoscope. An instrument used to present any type of stimulus material 
for a brief duration (see Fig. 10.23). 

Tautophone. Also known as a verbal summator. A phonograph recording of 
samples of a man’s speech is played at a low intensity. The subject listens and 


Fic. 10.23. "Tachistoscope. (С. Н. Stoelting Company, Chicago.) 
attempts to tell what was said. In doing so it is felt that he will “project” into 
his interpretation his own feelings of guilt, etc. 

Temporal maze. A maze used in studying a temporal succession of movements 
on the part of the subject without changes in the stimulating situation. It con- 
sists of two rectangular-shaped pathways having one side in common, The 


жаш 
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subject, starting up the middle pathway, must discover the key to a previously 
decided solution, such as twice to the right then twice to the left. 

Thematic Apperception Test. A personality test of the projective type. It 
consists of a number of pictures which the subject must use as an illustration for 
a story. 

Voice key. An apparatus used to measure the time required by a subject to 
respond with a word in answer to a stimulus word spoken by the experimenter. 
It consists of two microphones and а chronoscope in series with an electronic 
switch. The experimenter speaks into the first microphone starting the chrono- 
scope. The responses of the subject spoken into the second microphone stop 
the chronoscope. The reaction time is recorded by the chronoscope. 


Fra. 10.24. Wiggly block. (С. H. Stoelting Company, Chicago.) 


Wechsler-Bellevue Intelligence Scale. An intelligence test available for children 


or adults. It yields a verbal, performance, and full-scale I.Q. А 
Wiggly block. А cube of wood cut in several wavy pieces. The subject must 
assemble the pieces so ав to form the cube. It sometimes yields “sudden solu- 


tions” (see Fig. 10.24). { j t 
Zöllner illusion. Used as а demonstration of visual space perception illusion. 


It consists of a series of parallel lines wherein alternate lines are crossed at acute 
angles by shorter lines, each set slanting in the opposite direction. The parallel 
lines then appear to slant alternately in different directions. 


Apparatus Used in Specific Areas of Psychology. 

The following table will allow the reader to ascertain quickly the use in 
different areas of psychology of the various pieces of apparatus described 
above. If a piece of apparatus is checked in the first column, this indi- 
cates that it can be used in psychological experiments to present a stimu- 
lus to а subject. If the piece is checked in the second column, this means 
it ean be used to measure the response of a subject to a stimulus. The 
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ns ES T- T 1 
e|'d Sila 
le2g|3|3|s a 3/8 
Apparatus 23|58|£ E 2/3/38 E t 2 e/a 
б 2515215555) 
Aetiviby CABO ааыа аана э х |х хх 2 
Activity wheel............... x x x 
Аезіћеѕіотеёег.............. x X X x 
Ataximeter..... x X X X|X 
Audiometer... x X x x x 
Automatograph. x X EIX 
Barany chair............ «|| + х x 
Beat-frequency oscillator... .. x x x x 
Bell adjustment inventory....| X X bd 
Chronoscope х x ® 
Color wheel..... x x x 
Conditioning unit. x X X x 
Depth-perception box ........| X X X x 
Dynamometer........ x X x x 
Electrocardiograph. x X x х 
Electromyograph... T x X 
Electrostimulator............ x X X 
Ерізсойвіог................. x х х 
БОВЕ, сеа des piar ааа» х х X 
Eye-movement camera....... X X X 
Eye perimeter......... X X X X 
Galton bar... X x X x 
Galton whistle. . X X |X X 
Healy puzzle box. x X 
Impulse counter. . x х х 
Ishihara Test... x x x 
Koenig bars............. x X x х 
Kuder Preference Record. X X x 
Kwalwasser-Dykoma..... x X X x 
Kymograph.......... X X|X|X X 
Memory drum...... X XIX x 
Mirror tracing board X p.d Ж 
Miiller-Lyer illusion.... х х x 
Multiple-choice apparatus X x X 
Multiple-T maze......... m Ж i-e 
Obstruction box............. x Ж x xX X 
O’Conner Finger Dexterity 
jur MER х х х x 
O'Conner Tweezer Dexterity 
„ы. Ж НЕНТ ЧЕЛ artes х x 3 


next three columns, headed Pneumatie, Mechanical, and Electrical, 
respectively, show, when checked, whether the apparatus operates on a 
pneumatic, mechanical, or electrical principle. The remaining columns, 
when checked for a piece of apparatus, reveal those areas of psychology 
where the particular apparatus is most often used. 
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IEEE: " ERIE 
Apparatus 23|£882|8|8 ЕЕЕ 8 3 = HE 
382[82|8 8 383 3 8 3/885 
SERIEESPIEIEIEIFIEIEIESEIES 
Оасёотебег................ x X [X x X 
One-way vision screen. x X|X 
Oscilloscope.......... x x хх 
Photometer..... X x x 
Plethysmograph. X |X|X|X X 
Pneumograph... х |X х 
Polygraph..... X |[X|X|X X|x 
Problem box.... x x x 
Pseudophone........ x x x 
Psychogalvanometer......... X x x 
Pupillometer........ x x X 
Pursuit meter x x x X 
Reaction-time apparatus x x x > x 
Revised Stanford-Binet Test..| X x x 
Rorschach Test.............- x x x 
Seashore Test of Musical Apti- 
poo MN X X X 
Singerman's color-mixture ap- 
EDT ca cose дрога X x AX 
Skinner box...... x UP: хх 
Sound perimeter. x x xX} X 
рео а x x x x x x 
phygmograph. 2 =й RN DR eat IP Ls 
Stabilimeter " x XIX ххх 
Steadiness tester. x X E X 
Б(егеовсоре................ х х х 
Strong Vocational Interest E д 
а Віа MENT. е x = 
zondi Test. . oc 2 E „(о " z 
Tachistoscope » x х x x ® m 
Tautophone......... x x x 
Pv NM X|x | [5 x 
Temporal maze. x p „| 2 lis 
Volta Key... ccs | x к || [3 
Wechsler-Bellevue Tes A x x x x 
Wiggly block......... x = * 
Zöllner illusion... -++ 2 s x 


Useful Electric Circuits in Experimentation 


The experimental psychologist often finds that he needs a piece of 


apparatus to perform a certain function, but that such apparatus is either 
not readily available or else the price is too great. In analyzing these 
needs one finds that four basic electric circuits will perform the majority 
of the tasks desired. The following circuit diagrams were specially 
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designed for inclusion here with the idea of economy, efficiency, and sim- 
plicity governing the selection. Anyone with even an elementary knowl- 
edge of radio or electric circuits can easily construct the pieces of appa- 
ratus from these diagrams. 

Electrical Stimulator. This circuit (Fig. 10.25) will deliver an alter- 
nating current within the range of 0 to 35 milliamperes for any duration 


0-50 A-C 
60,0002 500 MILLIAMMETER 
ON-OFF SWITCH 
TRANSFORMER 
- SECONDARY 
ӨМӘ 1500 VAG OUTPUT 
VARIAG 


STEP-UP TRANSFORMER 


Fic. 10.25. Circuit diagram for an electrical stimulator. (From a design suggested 
by Dr. J. F. Pierce, Western State Psychiatric Hospital, Pittsburgh, Pa.) 


PTT 


€ 20а 

Сә О5дїа 

В, 50k pot 

Re 3klo 

R3 Sk l0w 

Sw Operating switch 
Tj !0Ovo-c/6.3v fil trans Sw 
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Fic. 10.26. Timing circuit. (Designed by George W. Townsend, Electronic Mainte- 
nance, U.S. Steel Co., Irvin Works, Dravosburg, Pa.) 


desired. It has been used by the author to deliver the unconditioned 
stimulus in conditioning experiments and as the shocking current in pro- 
ducing electroshock convulsions in rats. The circuit has the desirable 
feature of delivering a preset current which is insignificantly altered by 
changes in a subject’s resistance. 


ae 


Fy i 
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Timing Circuit. The circuit shown in Fig. 10.26 will close or open a 
relay (depending upon the type of relay chosen) for any preset duration of 
time throughout a range of 0.1 second to several minutes. This circuit 
may be used in conjunction with the electrical stimulator described above 
or anywhere where a stimulus is to be presented for a short controlled 
duration of time. 

Photoelectric Cell Circuit. In order to allow a light stimulus to produce 
a mechanical response, the circuit in Fig. 10.27 is suggested. In this cir- 
cuit, as drawn, each of the relays will respond to a different intensity of 


2 
3 
ANY VACUUM slg 
шх 
50 
A I 
в "ri 
8 a 
о| ж E 
FULL WAVE N po |; 5 
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o 
ш 
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Bufd 
ELECTROLYTIC 
COND. 


(Designed by George W. Townsend, Electronic 


Fic. 10.27, tric cell circuit. 
E a9 p Dravosburg, Pa.) 


Maintenance, U.S. Steel Co., Irvin Works, 
light, one of the relays closing and remaining closed at a low intensity and 
the other closing only when a more intense light is presented to the photo- 
cell. In this way the same light source can produce two different types 
of mechanical response, if desired. А " ^ 
Electronic Voice Key. When sound is the stimulus and itis desired to 
close or open a relay as the mechanical response, then the circuit in Fig. 
10.28 is most adequate. The circuit as drawn is aatiially complete for 
use as a voice key in experiments involving a subject s vocal response toa 
word spoken by the experimenter. Speaking into one of the sie 
starts the chronoscope and speaking into the other microphone stops the 


chronoscope. A. d 
These circuits are far more versatile than indicated here and will be 
found to serve in many experimental situations as some particular need 


arises. 


128 INTRODUCTION TO EXPERIMENTAL METHOD 


CHRONOSCOPE 


A 


[2) 
X 
T 


> 


e 
о 
< 
PILOT LIGH 
00000 


2 
o 
а 


TUBES A-TELEPHONE RELAY R- 20,000. 100w-VOLTAGE DIV. 
pengo" . B- ^ ^ Rr R3-100,0002 
2-"6Su7" c- ^ ^ Ro- Rq-250,0002 
3- "6S7 Ci Ca Ca- Ca- C7-Cg- Bufd-350VD-©  Rs-Re-10 MEG 
4- 2050 (2051) Cs-Cg- 25ufd - 50V D-C R7-Rg -0.5 MEG 
5- 2050 (2051)  C3-Cio-Ciı- Ciz- 0.001 ufd Rg-Rio- 20000 


Ti - Тг- MIC INPUT XMFR SB.TO SG. Ru-Rig-100.n 


Fra. 10.28. Electronic voice key. (Designed by George W. Townsend and John С. 
Townsend, U.S. Steel Co., Irvin Works, and West Virginia University.) 
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CHAPTER 11 


CONDUCTING THE EXPERIMENT 


The experimenter, prior to entering the laboratory for the purpose of 
performing his experiment, has gone far on his way toward answering his 
problem. He has selected a tenable hypothesis, defined his independent 
and dependent variables, introduced the highest degree of control over all 
known relevant variables—save the one chosen for the dependent varia- 
ble—provided adequate apparatus for the presentation and manipulation 
of the independent variable, settled upon a satisfactory procedure for con- 
ducting his experiment and collecting the results, and has reflected on all 
these things which constitute his research design in an effort to find an 
error in his plans. Satisfied that no one can voice a correctable criticism, 
the experimenter enters the laboratory. 

The experimenter should have prepared a written prospectus for his 
research project. Included below is a typical form on which may be 
written the major points pertinent to the research design and the execu- 
tion of the experiment. Space also is allocated to the statement of results 
and conclusions. Some laboratory directors insist that the research 
workers submit such a work sheet before attempting to conduct any 
experiment. Experiments can then be evaluated and altered if necessary, 
or not even attempted if the research design is poor. In some universi- 
ties, the laboratory courses in psychology consist of the performance of 
experiments by the students as а result of some research design that either 
the individual student or the class as à whole has developed. The form 
for presenting the research design included here makes an excellent report 
sheet on which students may submit their original research designs for 
proposed experiments. Later on in this book, the reader will see such à 
report sheet well done in respect to containing the basic information 
required under each heading on theform. The following work sheet when 
reproduced for use should have the items separated enough to provide 
ample space for the inclusion of as much information as required, 

Мате n= 
Section — — 
Га — 
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Form for Planning or Reporting Experimentation! 
1. What is the problem? 


2. State the problem in terms of a hypothesis. 


3. What is the independent variable? 
4. What is the dependent variable? 


5. How is the dependent variable (s) to be measured? 


6. What controls are necessary? 


What? How? Why? 


e RR P 


7. What is the procedure to be followed in conducting the experiment? 
4. Diagram the apparatus. 


b. Describe exactly what you plan to do. 
c. How do you plan to analyze the research results? 


8. Review the research design. 
a. What results, were they obtained, would support your hypothesis? 


b. What results, were they obtained, would fail to support your 
hypothesis? 


9. Conduct the experiment. 
a. What unplanned occurrences were present that may have influ- 
enced your results? 


! This form represents a revision of an original form developed at the University 
of Pittsburgh, 1946 to 1948, by Drs. R. W. Russell, H. W. Braun, A. J. Latham, 
W. S. Barker, and J. C. Townsend. 
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b. What were your subject’s reactions to the experiment (remarks, 
attitudes, ete.)? 


с. Summarize your research results in tables, graphs, and/or other 
clear means of presentation. 


10. Interpret the results. 
a. Describe your tables and graphs and statistical analysis from the 


point of view of proving or disproving the hypothesis. 


b. State your conclusions. 


In the laboratory, the experimenter will spend his time observing and 
recording the behavior of his subjects. All through the long and often 
tiring experience of data collection he must remember to obey the dictates 
of his research design to the letter. Any variation from his design, if not 
justified through some judicious change, will render his results meaning- 
less. There will be times when he will grow tired of the monotonous 
routine of performing the task of gathering data. It is here that research 
may lose some of the glamour that is often thought attached. But inter- 
est can be maintained if the experimenter develops the mental set of look- 
ing for occurrences which may lead to future hypotheses. It is not at all 
unusual for the trained experimenter to develop a “hunch” every time he 
"runs" his subjects. Such observations should be recorded for later 
Study, and possibly later experimentation. А А 

The collection of data moves most easily if the experimenter provides 
himself with a simple yet efficient means of recording his data. Research 
data should be collected in some neat, orderly fashion. To make the 
records permanent, all writing should be done in ink, Use of a hardback 
ledger type of data book is favored by some. In this manner, a perma- 
hent record is easily kept. Some experimenters collect their data on 
large sheets of graph paper on which there will be sufficient room for 
Working the statistical analysis without the labor and chance for error 
involved in recopying the data. This procedure works best when a large 
mass i handled. 

Data = e E only if they are identifiable. Otherwise they are 
just a collection of numbers standing for some quantity of an unknown 
quality. One way to make data meaningful is to collect them in Ed 
form. Generally, tables make for easy comparison of different values. 


"Their use in place of word descriptions of data is encouraged. 
An ая of а skeleton tabular form for collecting data throughout 
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the entire 10 trials of an experiment on one subject is given below. Such 
forms are often mimeographed if the number to be used is large. 


Title of experiment: 


Experimenter's name: 


Identification of subject Classification 


Name (or number) Experimental 


Address (or cage) Control 


Age Other 


Sex 


Remarks 


General remarks: 


The above table could be altered as shown on page 133 to allow for 
the collection of the results of all the data on, say, 10 different subjects 
during an experiment. 

These two tabular forms are more complete than those one would 
use for presenting data in a printed form, for example, in a journal article 
ог а textbook. But the data collection period is no time for reducing the 
data; instead, it is the time for elaboration. 

If facilities are available, data may be collected, sorted, analyzed 
statistically, and filed by machine sorting methods. This greatly simpli- 
fies the task of the experimenter in that once a card is punched on each 
subject, many desired operations can be quickly performed almost auto- 
matically. Unless a great number of subjects or a considerable amount of 
data are involved the machine method is unnecessary. 
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Title of table: 


' 
Subject Expt'l group Control group Renais 


(units) (units) 


Sum = 
Mean = 


S.E. Mean = 


Critical ratio Level of confidence 


General remarks: 


The data gathered during the performance of the experiment constitute 
the material from which inferences will be drawn in support or refutation 
of the hypothesis. Errors in data collection or its manipulation can ruin 
your experiment even if your research design were perfect and your inter- 
Pretation of the data faultless. Data collection represents, therefore, an 
important link in the chain composed of hypothesis, research design, 
collection and manipulation of data, interpretation, and koner iam on: 
Like any chain, it is no stronger, as the saying goes, than its weakest link. 


PART C 
INTERPRETATIONS AND CONCLUSIONS 


CHAPTER 12 


CENTRAL TENDENCY AND VARIABILITY 


When one surveys the literature of the entire field of science, one is 
impressed with the tremendous use psychologists make of statistics. 
Psychologists have developed this interest in the use of statistics for per- 
haps at least two reasons: (a) much of psychology deals with norms of 
behavior wherein statistical manipulation of data has been of extreme 
importance, and (b) psychology has been faced with the challenge of 
“proving” itself a science. The experimenter in psychology has been 
forced to be extremely critical of his results and has thus drawn heavily 
on the statistical methods for aid in analyzing and interpreting them. 
Perhaps the most severe critics of psychology have been the psychologists 
themselves, who have demanded the best critical thinking about the sub- 
ject. To many psychologists, results of experimentation not put to 
statistical analysis are results not properly analyzed. This is an extreme, 


though characteristic, point of view. 


Meaning and Use of Statistics 

Statistics is a term that has many meanings for different people. 
Broadly speaking, a differentiation can be made between descriptive 
statistics and statistical inference. The difference between these two terms 
is, essentially, one involving the use to which statistics is put. Descrip- 
tive statistics involves summarizing and describing data by means of 
various devices, such as measures of central tendency, measures of varia- 
bility, measures of relationship, the construction of graphs, the deter- 
Mination of the shape of curves representing the data, etc. Statistical 
inference deals with interpreting data and predicting what probably will 
happen from what has happened in the past. Such devices as the relia~ 
bility of differences between means, the degree of correlation between two 
variables, etc., are used in the process of statistical inference. ЭИ 

Basic to the use of statistics, and particularly from the statistical 
inference point of view, is the concept of the probability of the occurrence 
of an event. The probability of the occurrence of an event is 2 ratio of 
how frequently the event is expected to happen to the total possible out- 
137 
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comes. Thus, acoin tossed into the air has one chance of landing “heads” 
compared to the two possible outcomes “heads” and “tails.” А proba- 
bility ratio of 14 is then used to represent this situation. Another exam- 
ple might help. If we know that there are 100 marbles in a bag, 5 black, 
and 95 white, the probability of drawing a black marble is 5 chances out 
of 100, or written as a probability ratio, оо. This means that once out 
of each 20 times we may expect to draw a black ball by chance alone. 

Probability ratios can be discovered for most events. Two processes 
may be used to ascertain how frequently an event may be expected to 
happen in a given situation. First, one may assume through logical 
means that an event will rate a given probability ratio. This a priori 
method was used in the “bag of marbles" example just discussed. Sec- 
ond, one may not be able to arrive by logic alone at a probability ratio in 
regard to a question such as the following: ‘‘ What is the probability of a 
passenger being killed on a particular airline?" To establish a probabil- 
ity ratio for this event one would use the empirical method, and set up @ 
ratio of the number of individuals killed on the air line during a certain 
period to the total number of persons who rode the air line during that 
same period. 

Statistical inference is greatly aided by the concept of probability. 
The experimenter in interpreting his data makes a decision as to the 
acceptance of his results by observing probability ratios. The control 
group in an experiment furnishes, by an empirical method, the frequency 
of occurrence of a particular result in the absence of the independent 
variable. The experimental group reveals the frequency of occurrence of 
a particular result in the presence of the independent variable. Thus, if 
the experimenter finds that the probability of the occurrence of a change 
in his dependent variable without the presence of his independent variable 
is 50-50 and that when his independent variable is introduced the depend- 
ent variable changes 100 times out of 100, he has made use of probability 
theory in interpreting his results if he relates his independent variable to 
his dependent variable as cause to effect. "The first step of the experi- 
menter is one of collecting data which will tell him how frequently certain 
behavior occurs as a result of his manipulation of the independent varia- 
ble (experimental group) and how frequently the behavior occurs in 
absence of his independent variable (control group). A comparison of 
the occurrence of the dependent variable in these two groups, respectively, 
affords him an opportunity of arriving at an inference of relationship 
between his independent and dependent variables. 

Thus our task is (a) to find the simplest way of describing the frequency 
of occurrence of an event or a specific form of an event in our experiment, 
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(b) to find the simplest way of comparing the occurrence of the event in 
our experiment with the probability of its occurrence by chance alone, and 
(c) to find the simplest way of quantifying our level of confidence in 
accepting our experimental results. 


Measures of Central Tendency 


The raw scores one obtains from measuring his dependent variable con- 
stitutes his data. These data are called raw scores because they are as 
yet untreated statistically. Ordinarily, the beginning student in psycho- 
logical research does not find that his data are massive. Most often his 
data consist of single or paired scores on less than 30 subjects. When 
dealing with such small samples, it is common practice to treat the 
data in an ungrouped form. Ungrouped data are simply raw scores 
obtained on each of your subjects by your measurement of a dependent 
variable. 

In the following example we see ungrouped data presented in the usual 


tabular form. 


Subject Errors in solving a maze, X 
A 12 
B 6 
Cc 4 
D 3 
E 0 
F 1 
G 9 
H 6 
I 5 
J 4 


As the scores now stand they represent only a column of numbers. В It 
would be interesting for us to know the point at their center around which 
they all tend to cluster. We have three commonly used statistics which 
will allow us to calculate this central tendency of a distribution (1, 2, 3): 

Mode. The easiest measure of central tendency to calculate is the 
mode. The mode is defined as the most often recurring score. In general, 
the mode tells us just where in the data a concentration of measures exist. 
It is not a very reliable measure, but often serves as a quick, easy measure 
of central tendency. [ А 

In column a below, the mode is easily apparent. In column b, it is 
less obvious. In column с, we suddenly realize that a distribution may 
have two or more modes. Column ¢ is called a bimodal distribution (see 


Fig. 12.1). 
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a b с 
3 0 1 
5 5 3 
7 2 3 
7 4 2 
7 3 4 
10 5 6 
11 7 6 
14 9 6 
16 1 Ж 
17 6 5 


Mode = 7 Mode = 5 Modes = 3 and 6 


The mode is often called a terminal statistic because it is seldom used in 
the calculations of further statistical analysis on a given set of data. 


y 


о х 
о ! 2 3 4 5 6 T 


Fig. 12.1. Graph of a group of scores containing two modes. 


Median. A somewhat better measure of central tendency is called the 
median. The median is defined as the mid-point of a series of numbers. 
The median is quite easy to locate for ungrouped data. One places the 
scores in rank order from the lowest to the highest, or vice versa, and then 
finds the mid-point of the series. This is the median. The median finds 
its best use when there are extreme scores in the series which might distort 
the true picture of central tendency. 

In column a, below, the median is easily found because there is an odd 
number of scores in the series. In column b, the median falls halfway 
between two scores because there is an even number of scores in the 
series. In column ¢, to locate the median, one needs only to count half- 
way down or up in the series of scores, that is, 18, 10, 9, 8, 7, or 2, 3, 4, 6, 7. 
In column d, one sees that duplicated numbers are counted. 
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Median = 5 Median = 5.5 Median = 7 Median = 5 


Mean. The most often used and most reliable measure of central 
tendency is the mean. The mean is defined as the average or “arith- 
metic mean.” To calculate the mean, one adds all the scores together 
and divides their sum by the number of scores in the series. The statis- 
tican writes the calculation of the mean in terms of the following equation: 


sy 
Po 


N 


M = 


where M = mean, X means sum of, X = scores, and № = the number of 


Scores in the series. К -— 
The following is an example of the calculation of a mean of a series o 


Ungrouped scores. 


X 4 7 


ХХ = 52 
N = 10 
zX 52 
2 ХХ _ 382 _ 59 
M =a = 7975 


Th is ca ted so that the experimenter will have one number 
that ater | the other numbers in his distribution. When the 
experimenter wishes to compare two groups of subjects in terms of their 
Possession of agiven trait or behavior, he may doso by calculating and ~~ 
Paring their means. Thus the difference in the dependent нер 3 2 

аз been changed in the experimental group, as compared to ke = а 
group, where it may have changed even in the absence of the in m = 
Variable, is revealed in one manner, by subtracting the means of the two 


Broups, 
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Summary. Let us conclude our discussion of central tendency by calcu- 
lating the mode, median, and mean on one set of data and then showing 
their locations on a bar graph (Fig. 12.2). In a perfectly normal distribu- 
tion, the mode, median, and mean would all fall at the same point. The 
data in our example are not normally distributed. 


FREQUENCY, y 


SCORES, x 


Fic. 12.2. Graph showing the relative locations of various measures of central 
tendency in a skewed distribution. 


Measures of Variability. И one looks closely at two sets of data and 
compares them, he will notice that they are seldom identical. Instead he 
will observe that they not only differ in terms of central tendency, 2.., 
their means, medians, and modes are different, but that they also differ in 
terms of variability or “spread.” In the following table, distribution @ 
varies or spreads less than distribution b. 


a b c d 
4 2 1 1 
5 2 1 1 
6 16 1 2 
7 19 2 2 
9 38 3 2 
13 72 3 3 
14 104 4 3 
20 119 4 3 
21 120 5 3 
32 133 6 10 


Mean = 13.1 Mean = 62.5 Mean = 3.0 Mean = 3.0 


Total range = Total range = Total range = Total range = 
4-32 or 29 2-133 or 132 1-6 or 6 1-10 or 10 
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In comparing distribution е with distribution d, we see that although 
the means of с and d are equal, the variability of с is less than the varia- 
bility of d. Figure 12.3 shows this graphically. 

Total Range. The simplest way to quantify the variability of a set of 
data is to calculate the total range (№). Usually, in reporting the range 


FREQUENCY 


о [ 2 3 4 5 6 7 8 9 io и 
SCORES 


distributions having equal central tendency but different 


Fic. 12.3. Graph of two 
variability. 
s go from, for example, 2-133 as in dis- 


one simply st that the number: : А 
a row the total range in further calculations, 


tribution b. If one wishes to use 
he may use the following formula: 
R,=H-L+1 
Where Ri is the total range, H is the highest number in the series, and L is 
the lowest number in the series. 
Thus for distribution b, 
В, = 183 – 2 + 1 
В, = 132 


ution d or Fig. 12.3, we see an example of the false 


impression sometimes given by the total range. Nine-tenths 5 E 

Scores were no higher than 3 while only md of the scores, г ж d 
isi that the range can easily Con- 

one score, was 10. In this instance we see 

ceal the mt picture of a set of data. Because the presence of үк en 

in a series can so greatly alter the size of the total range, eee у! 

small samples, the range is considered the least reliable measure of varia: 

, 


If we look at distrib 
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bility. It should only be used when the scores are known to be widely 
scattered and when the total scatter of the scores is all that is desired. 

Average Deviation (A.D.) or Mean Deviation (M.D.). The best way to 
look at the concept of variability is in terms of how much each score 
deviates from the measure of central tendency of the distribution. If one 
calculates how much, on the average, the scores deviate from the mean 
of a distribution, he has calculated the average deviation for that distri- 
bution (1, 2). The formula for the average deviation is 


where A.D. is the mean deviation, Xd is the sum of the deviations of each 
score from the mean, and N is the number of scores in the series. 

In the following examples, we show the calculation of a average 
deviation. 


x d 

2 6 

3 5 

4 4 

4 4 

8 0 

9 1 

10 2 

12 4 

13 5 

15 7 

Total = 80 Total = 38 

m=2% ap- 
M=8% A.D. = 380 

M=8 A.D. = 3.8 


The average deviation is calculated without regard tosign. Thatis, 4 
from 8 is recorded in column d as 4, and 12 from 8 is recorded as 4. 

The use of the average deviation is usually restricted to instances in 
which a fairly quick method is desired of arriving at a number which will 
serve as a basis for comparing one distribution with another in terms 
of variability. 

If the average deviation is added to and subtracted from the mean of the 
series of scores, it marks off a range between the two calculated scores 
within which fall the middle 57.5 per cent! of the scores. This is demon- 
strated using the data from the example of the calculation of the A.D. 
given above. 


1 Actually, the 57.5 per cent value holds less true if the scores are not normally 
distributed. 
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M=8 A.D. = 3.8 
M + A.D. = 8 + 3.8 = 11.8 
M — A.D. = 8 — 3.8 = 4.2 


Therefore, 57.5 per cent of the scores fall between 4.2 and 11.8. This is 
shown graphically for a normal distribution in Fig. 12.4. 
Standard Deviation (S.D. or о). The most often used, and most 


POINT OF INFLECTION 


POINT OF INFLECTION~~ 


Fic. 12.4. Comparison of the per cent of cases marked off in a normal distribution 


by the standard and average deviations. 
reliable, measure of variability is the s 
ther statistics are to be calculated on a 
tion will almost invariably be part of the formula. 
is calculated in the example below. 
The procedure for finding the stan 


1. Find the mean of the series of scores. А 
2. Make а column d in which is recorded the deviation of each score from 


the mean of the series (X — W). 
- Make a column d? in which is recor 


Score in column d. 
. Find the mean of the d? column. 
- Take the square root of the mean of 


The formula for the standard deviation is 


ха? 
S.D. = AN 


Where S.D. is the standard deviation, Zd* is the sum of the deviations 
Squared column, and N is the number of scores 1n the series. 


tandard deviation (1,2,3). Iffur- 
series of scores, the standard devia- 
A standard deviation 


dard deviation is: 


ded the square of each deviation 


e 


= 


the d? column. 


e 
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x d d: 
1 —4 16 
2 —3 9 
2 —3 9 
3 —2 4 
4 =i 1 
5 0 0 
6 1 1 
8 8 9 
9 4 16 

10 5 25 

M= 5 Xd: = 90 
Zd? 90 

8р. = VF = Vig 

S.D. = V9 

S.D. = 


Note: A table of squares and square roots, Table A, is to be found in the Appendix. 


If the standard deviation is added to and subtracted from the mean of 
the series of scores, it marks off a range between the two calculated scores 
within which fall the middle 68.26 per cent! of the scores (see Fig. 12.4). 
As an example of the procedure for marking off the range within which 
fall 68.26 per cent of the scores, we draw upon the distribution above for 
which we calculated the standard deviation. 


M=5 S.D. = 8 
М+8.0. =5 +3 = 8 
М-– 8.0. =5-8 = 2 


Therefore, 68.26 рег cent of the scores fall between 2 and 8. 
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CHAPTER 18 


RELIABILITY OF MEASURES 


Let us look into the problem of using anything less than a whole popu- 
lation in conducting an experiment. 


Sampling 
ually makes use of whatis called sampling. 
In sampling, a few, or perhaps many, measurements are made of a trait or 
a characteristic possessed by the thing being studied. A cook samples the 
Soup by tasting a teaspoonful. From this teaspoonful, a generalization is 
made concerning the taste of all the soup in the pot. Perhaps the cook is 
judging a particular recipe for soup and makes the statement that not 
only is the particular pot of soup not “tasty” but doubts the “tastiness”’ 
of all soup past and future that depends on that particular recipe for its 
formula of ingredients. It is sometimes the same with experimenters 
other than cooks; they are tempted to make broad and loose generaliza- 
tions from insignificant samples. Experimenters and cooks alike should 
learn to say, “I am only certain that this particular teaspoonful of soup I 
am tasting is unpalatable to me. І cannot go farther without the risk of 
error,” 

verage size of the lumps of 


Suppose it became your job to report the a 
because you might be lazy 


coal in a railroad car. You would probably, 
efficient, decide that it would be too 


or to use a more innocuous adjective, 

much trouble and thoroughly impractical to measure the size of each indi- 

vidual lump of coal in the car and then divide by the number of lumps to 

arrive at the mean. Instead you would do as is usually done and merely 

sample the coal. You might gather a sample of perhaps the first 24 lumps 
You would now have 


of coal within reach and calculate the average size. о 
а mean which might be representative of the average size of all the lumps 


in the car. Now, suppose you recorded this mean and then decided to 
check it against the mean calculated from а measurement of all the lumps 
inthe саг. It is extremely likely that you would not find the mean of the 
24 lumps coinciding exactly with the mean of the 20,000 lumps in the car. 
The mean of the size of the 2 the sample mean; пе 

п 


mean of the size of all the lumps in 


In doing an experiment, one us 


4 lumps is known as 
the car is known as the true mean. 
1 
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error would likely be made if you calculated only the sample mean and 
tried to predict the true mean from it. 

In what way could the sample be improved so as to increase the chances 
of securing a sample mean close to the true mean without the burden of 
measuring all the lumps in the car? 

First, you could select your sample better. You might use a technique 
of sampling whereby you would in imagination divide the car into four 
sections: top right, top left, bottom right, and bottom left. You might, 
then, from these sections select at random a half dozen lumps from each. 
In this way, a better sampling might be selected. Better sample means 
that the sample would come nearer to having as its characteristics those 
aspects which are common to the population from which it was drawn. 
Such a sample is called an unbiased sample. 

А second way to improve your sample would be to increase the number 
of lumps of coal measured. You would probably secure a sample mean 
closer to the true mean if your sample were 100 rather than only 1. 

Third, your prediction of the approximation of the true mean would be 
more reliable if the lumps of coal were more nearly the same size. In 
other words, the more variation in the size of the lumps, the harder it is to 
find a small sample whose mean will approximate the true mean. 

If one found a mean of his sample of 24 lumps, recorded it, tossed the 
lumps back in the car, and then repeated the process many times, he 
would find that he would not always arrive at the same sample mean. 
Instead, there would be a distribution of means produced that would 
resemble the normal curve. 

Here is the point. The reliability or consistency of the mean of any 
sample depends on the amount of variation in such a distribution of sam- 
ple means. If the means of your samples varied greatly from one another, 
you would not have much faith in any one sample mean as indicating the 
size of the true mean. But if all your sample means hung closely around 
one mean then you would be more confident in accepting it as best repre- 
senting the true mean. 


The Standard Error 


From our discussion so far, we see that the reliability of a mean of 2 
sample depends upon (a) an unbiased sample, (b) the size of the sample, 
and (c) the variability of the distribution of sample means. If we could 
combine as many of these points as possible into a single formula, we 
might have a quick, easy method for finding the reliability of a mean of à 
sample. Statisticians have already done this for us. The formula for 
the reliability of a sample is known as the standard error of a mean (1,2, 
3). In reality, it is simply the standard deviation of the distribution © 
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sample means we talked about above. The formula for the standard 
error of a small random sample follows: 


5.Е.м огом = =т= 


where 5.Е.,, is the standard error of the mean, also written oy, с is the 
standard deviation of the scores in the sample, and N is the number of 


Scores in the distribution. 
An example showing the calculation of the standard error of the mean 


follows, 
If the mean of a sample is 100, the standard deviation is 10, and the 
number of cases is 26, what is the standard error or reliability of the mean? 


We see, then, that there are two ways to arrive at the standard error of 
а mean, First, we could go through the laborious process of a series of, 
Say, 200 random samples from the population and calculating the mean 
for each sample in the series. If we put all the means from the samples 
into a distribution and calculated its standard deviation, we would have 
our standard error of the mean. Suppose, for example, we found that the 
Means we calculated were sometimes as low as 68 and sometimes as high 
аз 80. The mean of these means would be the best estimate of the a 
mean of the entire population from which the samples were сн. Ti x 
Standard deviation of this distribution of sample means might be 2, an 
Would be the standard error of the mean. Figure 13.1 show how the m 
based on these hypothetical data would appear. Second, we could simp | 
lake one sample from the population, find its standard деу ee us 
divide by ЛҮ — 1. This would give approximately the same standar 


error as found in the first method. ; 
Ow that we have calculated the standard error of the sample mean, 


i iability? 

What does it allow us to say concerning the sample e e eoe Та 
First, i t the larger the standard error, the less reliable 

mean of ud nin In other words, the reliability of our sample mean 

; i ases. 

€creases as the size of the standard error increas E. 

Second, much of the interpretation of the meaning of à vpn ket 

tion is of use in interpreting the standard error of the mean ie сЕ 

Ple distribution. The standard error of a mean of a sample, 
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and subtracted from the mean, marks off a range of scores within which 
the true mean of the population from which the sample was drawn would 
fall 68.26 per cent, or approximately two-thirds, of the time. Three 
standard errors of the mean of a sample if added to and subtracted from 
the mean of the sample mark off a range of scores within which would fall 
the true mean of the population, from which the sample was drawn, 99.73 


G7 2 SCORE 
DISTANCES 


с DISTANCES —»—-3c +30 


SAMPLE MEANS —> 68 70 72 74 76 78 80 
DISTANCES -->6 4 2  TRUEMEAN 2 4 e 
IN SCORE POINTS 
Fia. 13.1. Sample distribution of 200 means and how their variability is measured 
in terms of the standard error. 
per cent of the time. Ап example follows which demonstrates this caleu- 
lation. The data used above in demonstrating the calculation of the 
standard error of the mean are used. 


M = 100 

ом = 2 
M + ex = 100 + 2 = 102 
M — ом = 100—2 = 98 


Therefore the true mean of the population will fall between 98 and 102 
68.26 per cent of the time (in a normal distribution). 


М +3 X ex = 100 + 3(2) = 106 
M — 3 хом = 100 — 3(2) = 94 


Therefore the true mean of the population will fall between 94 and 106 
(in a normal distribution) 99.73 per cent of the time. Since the true 
mean is a fixed value, it might be better to say that we are 99- 
per cent sure that the true mean will fall between 94 and 106. 
The calculation of the standard error of the mean is a meas 
reliability in that it tells you how confident you may be that the true 


ure of 
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mean rests within a certain range. For instance, you would be wrong 
only 5 times out of a 100 if you said the true mean of a large sample lies 
within the range of sample mean plus and minus 1.96 times the standard 
error. You would be wrong only 1 time out of a 100 if you said that the 
true mean lies within the range of sample mean plus and minus 2.58 times 
the standard error. In the first instance you would be confident at the 
5 per cent level of confidence, the second instance, the 1 per cent level. 

Every mean calculated is a sample mean unless the mean based on the 
scores of the entire population is calculated. All sample means should 
have their reliability stated by attaching to them their standard errors. 
This is usually done as follows: 


М = 100 ох = 5 
The correct way to report mean is М = 100 + 5. 
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CHAPTER 14 


COMPUTING SIGNIFICANCE OF DIFFERENCES 


In the factorial type of experiment one usually finds his data to be in 
the form of two means: one for the experimental group and one for the 
control group. Very often, these two means are close together. How 
is one to know whether the means of the two groups are far enough apart 
to allow one to say that a significant difference exists between them? 

We touched on this problem before. In our discussion of the null 
hypothesis, we said that in the use of a null hypothesis one assumes, until 
shown otherwise, that any difference achieved between the experimental 
and control group is due to chance alone. If, then, the results indicate 
only a small unreliable difference, or in other words, a difference that 
could easily be due to chance factors, we should feel little confidence in 
the difference and consequently accept the null hypothesis. On the 
other hand, if the two means are so far apart as to almost preclude their 
occurrence by chance then we should, at a certain level of confidence, 
reject the null hypothesis. 

If the experiment has been highly controlled in that the only known 
difference between experimental and control groups was the presence of 
the independent variable in the experimental group, and the results 
indicate that the difference in the two groups in terms of the mean of the 
measurements of the dependent variable was so large that it could have 
occurred only once in a hundred times by chance alone, then we are 
justified in rejecting the null hypothesis at the 1 per cent level of confi- 
dence. We then go farther, as a rule, and state that the independent 
variable produced a difference in the two groups significant at the 1 per 
cent level of confidence. 

Let us now see how to go about evaluating differences between means 
in the search for significance. 


The ¢ Test 


The name applied to the statistical techniques which allow one to йай 
with the significance of differences between means in small independen 
samples is the £ test (1). In general, the ¢ test involves the ratio of the 
size of the difference between two means to the size of the standard ert" 
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of the difference between the two means. ¿may be used in dealing with 
either large or small samples, and is simply the evaluation of a statistic in 
terms of its reliability. 

Assuming the true difference to be zero between the groups in respect to 
the trait measured, one calculates £ to see how many times out of 100 a 
difference as large as was obtained could have happened by chance alone. 
To do this, one divides the difference between the means for the two 
groups (D) by the standard error of that difference (5.Е.). The more 
times S.E.» goes into D the wider is the distribution of differences 


between the two means. 


258 1.96 


~<--SIZE OF CRITICAL SAU lief -— ; j 
Fic. 14.1. Size of the critical ratio as related to level of significance for a norma 
distribution, (When both tails of the curve are considered, 1.96 — 5 per cent level 


and 2.58 = | per cent level.) 


When the number of cases is very large, say more than 100, results s 
the ¢ test very closely approximate the results of тоге ауа o 
arriving at the significance of difference between means known as em a 
ratio. Assuming, then, that one has conducted the é sas оп a ~ ie 
Sample, Fig, 14.1 shows that as the “true diens varies m n 
then the 8.8. divided into D yields larger critical ratios. One S.E.» 


i mal 
plu i ks off 68.26 per cent of the cases ina nori 
S and minus the mean mar us the mean marks off 95 per cent, 


distributi min i 

merh id m off ат Thus if the distribution versi 

distributed, one would expect a critical ratio as large as € pan 

S.E.» five times in a hundred if the true difference а : e асч oe 

Zero (5 per cent level of confidence) and as large as 2.58 times .E. 

only once in a hundred times (1 per cent of одаи). — 
The ¢ test applied to small samples requires the use of a sp' 
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wherein a correction is made in terms of the size of the sample (see Table 
B in the Appendix). If one has conducted an experiment wherein he 
has 10 subjects in the experimental group and 8 subjects in the control 
group, the degrees of freedom equal (Ni — 1) + (Nz — 1) or 16. Table 
B shows that he can reject the null hypothesis at the 5 per cent level of 
confidence if t equals 2.12, and at the 1 per cent level of confidence if t 
equals 2.92. 


Detailed Calculation of t 


In the following itemized procedure, the progression of operations 
necessary to arrive at ¢ is given. 


ITEMIZED PROCEDURE FOR FINDING t 


Group І | Group П 


Date result result 
d КИДИК qs auc aes E ane Bares eon UR RUSSE MU ue ines Mi M: 
2. Find how much the mean deviates from each separate meas- 
Ө = ШЕ artes E Bice ns aa Pens RO ake anus vis ик ds d dı 2 
3. Square each of these deviations found in (2) above......... dj? dj 
4. Find sum of these squared deviations found in (3) above. ... ха? хаг 


5. Ааа Zd;? to 2d; and divide by (Ni — 1) + (№ — 1). Note: 
№; = number of cases in group І апа N, = number of cases 1n 
group II. 

6. Take square root of result found in step 5. This equals the com- 

bined S.D. of the groups. 

. Divide the sum of N; and №, by the product of №, and Nə. 

. Take the square root of result found in step 7. 

. Multiply the result found in step 8 by the S.D. found in step 6. 

This equals S.E.». 

10. Find difference between M; and M, (neglect sign). 

11. Divide difference between M, and M; found in step 10, by S.E.» 

found in step 9. This equals £. 


oon 


In order to simplify the task of the experimenter in arriving at a t, the 
work sheet which appears on the following page has been developed bY 
the author. On the page following the work sheet is a demonstration 0 
the calculation of ¢, using the work sheet. 

When t has been calculated for the difference between the means of the 
two groups, the final decision must be made as to whether to accept ET 
reject the null hypothesis. In other words, it must be decided whethe 
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Worx SHEET FOR COMPUTATION OF t 


Group 1, experimental Group 2, control 


Raw scores, Хз | dı | di? | Raw scores, X| d: | ds? 


M, = A а a aie 
2X3 А 
c - Id = 
M: = Ne А 
ха? + Xd: + т 
EET: D 
N.N: ae = 
SE» = 8D. Vy —— 4 
M, - М = —_— = (neglect sign) 
mu ў 
«.. &E» 


Degrees of freedom 
alue of t required for significance at: 
m 34 of confidence ———— 
level 
Note: m ean tr to find significance, the degrees of freedom are equal to 
(Vi — 1) + (N: — 1), that is, the number of scores in the first group, minus one, are 
added to the number of scores in the second group, minus one. 


caused the difference between the two 


being studied. 
е to the 5 per cent and 1 per cent 


f the significance of your results 


or not the independent variable 
groups in respect to the behavior 
On the work sheet, there is a referenc 


levels of confidence. The evaluation o 


i be at the 
ma; з s hether or not ¢ 15 large enough to 
‚маде eee If by going to Table B in the Appendix 


1 per cent level of confidence. р 
it is found that i in your баша s less m. M S с a 
signifi cent level of confidence, l 
following e e aes accepted your null hypothe. 
If your ¢ equals or exceeds the va с dens эш е pa 
cent level of confidence, then you may reject the null pud 
accept your independent variable as related significantly to Ше der p 
Variable, s which fall short of the value required for us ca E a 
1 per cent level of confidence but which are equal to or larger tha 


if you 
lue required for 
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Worx SHEET FOR COMPUTATION OF t 


Group 1, Experimental Group 2, Control 
Raw scores, X1 di dı? | Raw scores, Хә] d: а}? 
2 —8 9 3 —3 9 
3 —2 4 2 —4 16 
4 —1 1 4 —2 4 
4 —1 1 4 —2 4 
5 0 0 7 1 1 
6 1 T 7 1 1 
3 —2 4 8 2 4 
5 0 0 9 3 9 
7 2 4 10 4 16 
11 6 36 6 0 0 
_ ХХ _ 50 р ZX: _ 60 ха? = 64 
Mı, = N, -— = Zd: = 60 М» = Ns io ^9 Ed» 
уа + хап 60 + 64 
‚О. = = = 2.62 
Леа р Vee NM 


2 Ni + Ne _ 10 +10 _ 
S.E.» = S.D. VS = 26 V00) = 19 


Mı — М» = 5 — 6 = —1 (neglect sign) 
QMI—M.. 1 - 
cepa, ы 55 


Degrees of freedom — 18 
Value of t required for significance at: 
5% level of confidence 2.10 
1% level of confidence 2.88 

Note: In using the table to find significance, the degrees of freedom are equal to 
(Ni — 1) + (N: — 1), that is, the number of scores in the first group, minus one, ате 
added to the second group, minus one. 


value required for significance at the 5 per cent level of confidence are 
usually reported, but are only regarded as a possible indication of a trend - 
toward disproving your null hypothesis. Experimental results significant 
at less than the 5 per cent level of confidence are, in the author’s opinion, 
too near the wheel of chance to be taken seriously. 


Chi-square Technique 


This statistical technique is included here so as to allow the student 
to test the significance of certain results that cannot be handled by the 
use of the ¢ and correlation techniques. For the most part, the dat we 
talked about previously were in the form of a series of numbers or paire 
scores representing the measurements of the variables in the study. We 
could calculate means and standard deviations on such data. Now, 
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suppose you have decided to test the hypothesis that students at your 
university prefer athletic events to theatrical productions. Your proce- 
dure would consist of questioning, perhaps, 100 students as to which they 
prefer and recording their preferences. Out of the 100 students let us 
suppose that 63 said they preferred athletic events and 37 said they 
preferred theatrical productions. Is there a significant preference for 
the former? 

Obviously, the data are of such a nature that some technique other 
than ¢ or correlation is needed to deal with the results. The chi-square 
(x2) technique will provide the answer in this case. 

In applying chi square, the observed results are compared with the 
results expected according to some hypothesis about the population. 
In our example, we would hypothesize that just as many students would 
prefer athletic events as would prefer theatrical productions. This 
would be a 50-50 hypothesis ога null hypothesis where any deviation 
from this 50-50 proportion would be hypothesized as due to chance 
fluctuation. In our study, we found that the split was 63-37. 

Chi square will allow us to test for the significance of the divergence of 
our observed frequency from that expected on the basis of the equal prob- 
ability hypothesis. If we find that the answer to our chi-square problem 
indicates that a divergence as large as the one We observed could have 
happened by chance alone only one time in a hundred, then we can make 
the statement, at the 1 per cent level of confidence, that the students 
preferred athletic events to theatrical productions. 

The formula for finding chi square is 


„жа Ў, E X a] 


Where (f,— f)? is the squared differences between the observed and 
expected frequencies, fe is the expected frequency ш terms of some 
hypothesis about the population, and Z means the sum of. 


Steps for Calculating x? 
1. Record in the appropriate cells of the table that follows the observed 
frequencies of occurrence under the various categories. 
2. Record in the appropriate cells of the table the expected frequency of 


occurrence under the various categories. А 
3. Record the totals of the observed and expected frequencies, respec- 
tively, in the space provided. 
4. Find the difference between eae 
each category. 
5. Square each of the differences 


h observed and expected frequency for 


found in step 4. 
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6. Divide each squared difference in step 5 by its corresponding expected 


frequency as recorded in step 2. 


7. Find the sum of the items found in step 6. This is the chi square. 

8. Determine the significance level of the chi square by finding the 
degrees of freedom by the formula df = (r — 1)(c — 1), where df is the 
degrees of freedom, r is the number of rows, and c is the number of 
columns dealt with in your chi-square problem. Consult Table C in 


the Appendix. 


In applying these steps for finding chi square to our example previously 


cited, we proceed as follows: 


TABLE 1. CALCULATION or CHI Square ror AN Equa Рковлвпиту HYPOTHESIS 

Prefer Prefer 
athletic theatrical Total 
events productions 

Observed (fo) 63 37 100 

Expected (f.) 50 50 100 

(fo — fe) 13 —13 

(fo — J)? 169 169 

e == Ja s 
dem 3.38 3.38 x? = 6.76 


df = (r —I)-1) = (2 — 1)(2 — 1) = (1)(1) =1 


Consulting the table of chi square, Table C in the Appendix, and enter- 
ing it with one degree of freedom, we find that a chi square of 6.76 could 
occur less than once in a hundred times by chance. Therefore we have 
sufficient reason for rejecting the equal probability hypothesis and can 
say at the 1 per cent level of confidence that the students prefer athletic 
events to theatrical productions. 

This is the general scheme by which chi squares are calculated. Cer- 
tain conditions may arise that will alter the above table. Some of these 
conditions follow. 

1. We may be dealing with more than two categories as when а ques- 
tionnaire might be given that calls for responses to be recorded as failing, 
poor, fair, good, and excellent. In these cases, simply use more columns 
headed by the descriptive terms, record the observed and expected fre- 
quencies for each, and proceed as usual. When two categories were use 
and it was hypothesized that a given category had a 50-50 chance of being 
chosen, we simply divided the total observed frequencies by 2 and recorde 
the quotient in each of the two cells for expected frequencies. If there 
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are five categories of response, then divide the total observed frequencies 
of response by 5, and record the quotient in each of the five cells for 
expected frequencies, etc. 

2. It may happen that the equal probability hypothesis does not apply 
and some other hypothesis may be needed. This most often happens 
when the occurrence of an event may be normally distributed through the 
categories instead of equally distributed. This will occur, for example, 
when we force categories on a distribution of intelligence scores so as to 
check if our observed frequencies vary from the expected. In such a 
case, if we used five categories, such as borderline, low normal, normal, 
high normal, and superior, we would not expect each category to have the 
same frequency. There would be a high frequency of normals and lower 
frequencies at extreme categories because intelligence follows a normal 
distribution. When one runs into this type of chi-square problem, he 
should consult Garrett (1) for the correct procedure of calculating 
expected frequencies. 
BIBLIOGRAPHY 
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CHAPTER 15 


TESTING FOR THE SIGNIFICANCE OF RELATIONSHIPS 


In the functional type of experiment, one arrives at data in the form of 
paired scores. These paired scores represent the changes in a dependent 
variable as an independent variable is manipulated. Each step up the 
continuum of the value of the independent variable appears to be accom- 
panied by a change in the dependent variable. In order to quantify the 
relationship which may exist between the independent and dependent 
variable, correlational techniques have been devised. It must be noted 
that one can only calculate a correlation from paired scores. 

Correlations may be negative, to some degree, positive, to some degree: 
ог zero. Correlational techniques have been devised so as to always pro- 
vide an answer somewhere between minus one, through zero, to plus one. 
The correlation has been incorrectly computed if one finds it to be more 
than plus or minus one. 

A positive correlation means that as variable A increased so did variable 
B. Correlational values such as +.54 or +.78 or +1.00, etc., are exam- 
ples of the type of answers to be expected when related variables are COT 
related positively. It should be noted that a correlation value, or 7 aS a 
is symbolized, of .50 does not mean one half or fifty-hundredths of a per 
fect correlation. If one wishes to convert an т into hundredths of a pe!" 
fect correlation, he may do so by squaring the value ofr. In our examp!© 
an r of .50 is .50° or .25 of a perfect correlation. A negative correlatio? 
means that as variable A increases variable B decreases. Negative corte 
lation values may be revealed by an r of —.72 or —.63 or — 1.00, etc. 

A zero correlation means that no relationship exists between variable 
А and variable B. Correlations at, or not significantly different from, 
zero are indicative of no relationship. 

A correlation does not prove a cause-and-effect relationship betwee” 
the two variables involved, but when a strong significant correlation 
exists between changes in the independent and dependent variable, the у 
support is felt for rejecting the null hypothesis. The null hypothesis у 
functional, or correlational, studies is that the true correlation is zero ? É 
that any apparent relationship between the two variables is due to yc 
fluctuation. If one tests the calculated т for significance and finds tha 
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correlation as large as it can be expected only once or less than once in a 
hundred times by chance alone, then he may reject his null hypothesis at 
the 1 per cent level of confidence. A table is provided in the Appendix 
for testing the significance of r. 

In the following treatment of methods for computing correlations, two 
Specific techniques will be demonstrated. The first is known as the rank- 
difference method, the second, the product-moment method. 


Rank-difference Method 


The rank-difference method (1) is most applicable when dealing with 
scores that have been placed in a rank order of merit, and when not more 
han 25 paired scores constitute the data. 
The following is an itemized procedure for calculating the rank-differ- 
ence correlation value. 
The rank-difference correlation value is represented by the symbol p, 
Pronounced rho. 


Itemized Procedure for the Calculation of the Rank-difference 
Method of Measuring Correlation 


1. Кесога the paired raw scores for the two variables in columns X and У. 
- Assign ranks to each score in the X column. Then do the same for the 
Y column, Assign the number 1 to the lowest score in each column, 
ete. In сазе of duplication of scores, t.e., if two or more subjects 
Should receive the same ranks, do as indicated below. 
ышт R ee 


Scores Ranks 
Subject 

X c X; Yi 
A 2 1 1 1 
B 3 2 2 3.5 
С 4 | 2 | 8.5 | 3.5 
D 4 | 2] 3.5 | 3.5 
E 5 2 5 3.5 
Е 6 | 3 | 7.5 |6 
G 6 4 7.5 7 
H e|6| 7.5 | 9 
I 6 6 7.5 9 
1 8 6 10 9 


ИЛИ MLSS A 
` Make a D column which is filled in by subtracting the two ranks in 


columns X, y, for each corresponding pair of scores. 
ake a D? column which is filled in by squaring each D value in 
column D, 
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Worx SHEET FoR COMPUTING THE RANK-DIFFERENCE METHOD OF MEASURING 


ConRELATION 
Scores Ranks 
Subject D D? 
X ¥ Хх, Yi 


QU» 


Nom. >р? = 
mE 
NW? i) 
6( ) 
LI 
=l]-— 
аЙ. > 


Work HEET ror COMPUTING THE RANK-DIFFERENCE Мєтнор or MEASURING 
ConnELATION 


хт ж] 
А 4 | 6 4 6 2 4.00 
B 5 | 5 5 4.5 5 ‚25 
С 6 | 7 6 7 1 1.00 
D 9 | 8 9 8.5 5 .25 
E 11 9 10 10 0 .0 
F 758 7 8.5 | L5 2.95 
G 8 | 4 8 2.5 | 5.5 | 30.25 
H TE 2 1 1 1.00 
I 0|4 1 2 | ws 2.25 
J 2 |5 3 4.5 | 1.5 2.25 


N=10 хр = 43.50 
|| 6zD? 
NN: i) 
= 1 — — 6(43.5)_ 
10(100 — 1) 


tou 
н 
1 
io 
e 
© 
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5. Find =D? by adding the D? column. 
6. Substitute into the following formula: 


ye 
p= VN- 1) 


Note: Be sure to solve the part of the equation to the right of the minus 
sign and then subtract from 1.00. Negative p will be found when the 
value to the right of the minus sign is greater than the value of 1.00 at the 
left of the minus sign. 

On the opposite page is a work sheet for use in measuring correlations 
by the method of rank difference. F ollowing the work sheet is a 
demonstration of the calculation of p using a hypothetical set of data. 


Product-moment Method 


This method (1) is more accurate and more convenient when the num- 
ber of cases is large. An itemized procedure for computing a measure of 
Correlation by this method follows. 


Itemized Procedure for Computing the Product Moment 
Method of Correlation 


1. Find the means of the X and Y columns of raw scores. 

2. Make a column d, in which you record the deviations of each raw score 
in column X from the mean of column X, that is (X — M. J- Make à 
Column d, in which you record the deviation of each raw score in 
Column Y from the mean of column Y, that is (Y — M). In both 
Columns make certain that the minus sign precedes the deviation if the 
Mean is larger than the score from which it was subtracted. 

8. Multiply each number in the d. column by each corresponding number 

™ the d, column, and record in a dd, column. Make certain that the 

Correct sign is affixed to the products in the d.d, column. Find the 

Sum of the d,d, column, and record as Zd.d,. | 

Quare each number in the d; column, and record in a 0,2 column. 


j 2 
Quare each number in the d, column, and record in a dy wer 
у 


З ха? 
Find the mean of each of these columns, and record as E and N^ 


respectively, , 
he standard deviation of X, or т, is found by taking the square root 


Zd,? d А 
* A The standard deviation of Y, or øy, is found by taking the 


ct 


Square root of A 
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6. Substitute the above factors into the following formula and solve: 


Ed, 


"= = 0.) (е) 


М(с.)(с,) means the number of paired scores times the standard devia- 
tion of column X times the standard deviation of column Y. 


Shown below is a work sheet for caleulating the product-moment 
method of correlation. Included on the work sheet is the formula for 


Work SHEET FOR CALCULATING THE Ркорост MOMENT COEFFICIENT OF CORRELATION 
(Ungrouped data) 


Subject x E а. & | did, d; ал 

А 

B 

© 

«у П | fL [_] 

N= Мх = My = 
54,1, = zd? = _ Уй = ——— 
-o Edid, Eds _ ха 
"= Ned) N 7 ya 


Reliability of rzy: 
U=) 


Ory = ~ 


“усл оо 


Value of rz, required for significance at: 
5% level of confidence: 
1% level of confidence: 


calculating the standard error of r. The standard error of r is inte? 
preted in the same fashion as any standard error of any statistic when 7 18 
small. Table D, Correlation Coefficients (г) Required for Significance * 
the 5 per cent and 1 per cent Levels of Confidence, in the Appendix - 
aid in establishing the significance of r. Following is a work-shee" 
demonstration of the product-moment method using the same set of dat? 
for which we caleulated p. Notice that p differs from r in this examp'? 
by only two-hundredths (.02). 
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Work SHEET ror CALCULATING THE PRODUCT MOMENT COEFFICIENT OF CORRELATION 
(Ungrouped data) 


ep 
Subject | x | Y | a d, 44, аз d; 

A 4 6 —1.3 2 — .26 1.69 04 
B 5 5 = 38] -.8 24 .09 64 
С 6 7 7 1-2 84 .49 1.44 
D 9 8 3.7 2.2 8.14 | 13.69 4.84 
E " 9 БИ 3.2 18.24 | 32.49 | 10.24 
F i 8 1.7 2.2 3.74 2.89 4.84 
G 8 4 2.7 | —1.,8 | —4.86 7.29 3.24 
H 1 2 | -4.3 | -3.8 16.34 | 18.49 | 14.44 
I 0 4| —53 | -1.8 9.54 | 28.09 3.24 
J 2 5 -3 - 8 2.64 | 10.89 64 
Z 

————— ы 1 SS 

N Xds = 116.10 xd, = 43.60 


=10 Mx =53 M=58 Zd.d, = 54.60 


fap Edid, 
(М) (ez) (су) 
_ _ 5460 
— 10(8.4)(2.1) 
= 765 
= .76 
Reliability of rey! 
Tn, = — т) _.422 


Мет з 4 
Val 
че of rey required for significance at 


i ind of confidence .632 
evel of confidence .765 i i 
n eqni of freedom for correlation equals number of paired scores minus two 
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CHAPTER 16 


THE CONSTRUCTION OF GRAPHS 


The presentation of the data and results collected through the process 
of experimentation produces a problem for the experimenter. Ordinarily, 
he has manipulated his data statistically so that certain trends, differ- 
ences, and relationships are expressed numerically. For those who under- 
stand statistics, data and results expressed statistically are written in a 
common, easily understood language. Those not understanding statis- 
ties fail to derive any accurate meaning from results so expressed. It 18, 
therefore, important that the data and results of research be expressed in 
some form that will be easily comprehended by all those who desire the 
information contained in them. Besides the need for expressing results 
simply and directly there is also the need for expressing results in such & 
manner that the information included can be used in many situations. 
To do these jobs, the data and results are often expressed in graphical 
form. Using graphs as pictures О 
what happened in an experiment pro- 
vides the most efficient and useful way 
of making the data meaningful to the 
GUINEA greatest number of people. 


(555) Types of Graphs 
Most often only three basic types 
of graphs are used. Let us take а loo 
at each of these types. ^ 
Circle Graphs. The circle graph ® 
one of the simplest means of ped 
ing data in graphical form. Or Rf 
Fra. 16.1. А circle graph. narily, this type of graph is used ja 
portray the ratio of parts of the dë 
collected to the total amount of data collected. Ratios may be express? 
as percentages of a circle. This “pie” type of graph is shown in Fig. 1 s 
Each sector of the circle corresponds to a certain ratio or percentage m 
theentire circle. In Fig. 16.1 we see at a glance that there are more Tie 
than any other kind of animal in the colony. Since 360° of the ©” 
166 М 
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Corresponds to the total number of animals in the colony, then a given 
oo of one species of animal should be represented by a sector of 
a circle whose size is that per cent of 360°. For example, 65 per cent of 
he total number of animals is composed of rats. Then, a sector whose 
m is 65 per cent of the total area of the circle should be devoted to them. 
t is perfectly legitimate to include the number of animals in each section 
and the per cent they represent of the total colony. This has been done 
In the above example. 
GET tain types of graphs are used to represent certain types ofdata. A 
3 les of data may be either discontinuous or continuous. A discontinuous 
eries of data is one in which the things dealt with differ from one another 
e iiey or by a given quantitative amount. For example, dogs, 
= K and rats belong to a discrete qualitative series (categories) in terms 
tim nd of animals. You may fire a pistol 2 or 3 times but never 2.5 
NS This would be a discrete quantitative series. A continuous 
in E. of data is one in which the things dealt with are connected by fine 
Hs reradations of value. For example, a stick of wood may be 2 feet 
Inches long or 2 feet 3.2 inches or 2 feet 3.25 inches long, ete. Circle 
- may not be used to represent continuous data series. For con- 
2 data, the line graph, discussed later, is more appropriate. 
ж ar Graphs. This type of graph has a “ graph” appearance, for it looks 
ore like the graphs one sees in textbooks and scientific publications. 
ae bar graph is built upon a coordinate system. The coordinates 
ah ved are two straight lines drawn at right angles to one another and 
a tsecting at a point called the origin. The horizontal line is called the 
eet and the vertical line is known as the ordinate. We will use these 
of erms repeatedly in our discussion of graphs. As seen in the system 
Coordinates of Fig. 16.2, each coordinate extends from a minus value 
Tough zero to a plus value. 
gen graphs utilizing a coordinate system, 
= Scissa and ordinate are used. These graphs start 
om in Fig. 16.3. 
of cy emm of Fig. 16.4 the mean о 
i E Stribution is from —4 to +6. 
15 from 1 to 6. 
"a н Braphs of the type shown in Figs. 16.4 and 16.5 are called histo- 
tributi Histograms are used when one 1$ dealing with a frequency dis- 
10n, Z.e,, the data have been grouped into step intervals. ; 
can be seen in Fig. 16.5, the histogram is drawn from an abscissa, 


only the positive ends of 
with coordinates, 


f the distribution is 0, and the range 
In graph b, the mean is 3, and the 


ү i i H . 
aed is divided into equal units with each unit representing one step 
erval distance along the base line. The ordinate is divided into equal 
ber of scores in a step interval. 


Uni: S 
representing the frequency or num 
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Fia. 16.2. A system of coordinates. 


o x 
o 1 2 3 4 е © 


Fic. 16.3. Positive coordinates used in most graph construction. 
The length of the abscissa is such that all the step intervals can be placed 
along it, and the ordinate is long enough so that it has as many units e 
necessary to represent the maximum frequency in any step interval in * 
distribution. 'The mid-point of each unit on the abscissa is usu р 
labeled by a number representing the mid-point of its corresponding on 
interval in the distribution. Rectangles, or bars, are drawn so that * 
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о х 
F о ] 2 3 4 5 6 | 
IG. 16.4 positive and negative values, and 


iF. * Graphs drawn on coordinates involving 
Positive values D 


ues, respectively. 


y 
Raw STEP 
6 DATA — |iNTERVALS| FREQUENCY 5 
m 22 30 : 
2 зә А 
I$ ет ља : 
15 28 35 3 
5 29 37 Н 3 
7 28 37 
= 29 40 a 2 
B AS ae > 
П 
x 
02 T 12 17 22 27 32 37 42 
Fic. 16.5. Histogram. 
Wi А | 
ue of the bar corresponds to the width of the unit representing m ~~ 
: r ni 
а, and the length of the rectangle, or bar, sani ae t с E ` 
рат te ordinate representing the frequency of € o; pei 
DAE i i tep intervals are co 
Step inter metimes, the step у J 
ma oa : he abscissa. There is 


Ordinate and the frequencies are placed on t 
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no objection to this, except that such a practice is less common than the 
former method of construction. A space is usually left at each end of the 
histogram so that one-half of the next possible, but unoccupied, step 
interval is shown. 

The histogram in the above discussion is drawn from continuous data. 
This is correct, but is not ordinarily as useful as a line graph would be in 
representing continuous data. Figure 16.6 shows a bar graph represent- 
ing discrete or “exclusive” categories. This is the more common applica- 
tion of the bar graph. 


4500 
4000 
(= 
Еа 
2 3500 
ws 
КЕ 
n [*] 
5 = 3000 
ae 
2 б 
Z 2500 
20 
= 
2000 
1500 


1944 1945 1946 1947 1948 1949 1950 
YEARS 
Fic. 16.6. Bar graph representing categorical data. 


The bar graph in Fig. 16.6 is read by moving out the abscissa to the 
year desired and going up to the top of the bar and across to the number 
of students indicated at the point of intersection with the ordinate. 

Line Graph. This type of graph has more uses than the others me? 
tioned in that it usually represents the relationship of two continuous 
variables. A line graph should not be used to represent discrete classes 
since a false impression would be created by a continuous line connecting 
several categories. 

The simplest type of line graph is shown in Fig. 16.7, where the data 
from Fig. 16.5 are used and the line graph is superimposed on a histogram: 

One can see that the line curve is drawn in such a manner as to conne? 
the mid-point of the step intervals at a distance above the abscissa CO 
sponding to the frequencies of the step intervals. The line curve is dT awi 
beyond the extreme step intervals containing a frequency to the mid-po” 
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of the nex i 
eel p. m interval. Thus, the curve is "closed" against th 
ine curve of this nature is called a frequency polygon à 


y 


= 2 7 12 7 22 27 32 з 42 47 * 
їс. 16.7, Frequency polygon superimposed on a histogram. 


Other li 
ne i P a 
shown in Te ta may begin and end “ир in the air,” so to speak, as 


y 
5 


о 
o ] 2 3 4 5 6 7 


Fic. 16.8. Line curve. 


Such 
i а graph, as is true of all line graphs, relates а change in the func- 


lon re 
as a by the abscissa to а change in the function represented 
ime ‘inate. АП simple line graphs are read by locating a point on 
in terms of rectilinear coordinates drawn from the abscissa and 


© ordi 
h mate. For example, in the preceding figure (Fig. 16.8) we see 
of the abscissa and four 


20 poi ; : : 

Units P is five units from the origin in terms 
th the origin in terms of the ordinate. Thus, a value of five for 
Jated to a value of four for the 


© Vari 
Table ү, 5 » 
le represented on the abscissa is re 


Variable on th 


e ordinate. 
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After one has gathered his data and plotted the points on his coordinate 
system so that each point represents the relationship of one variable to a 
given value of a second variable, the problem then arises of connecting the 
various points so as to form a line graph. If one merely draws a straight 
line from each point to its adjacent point, then he has produced a line 
graph showing an observed relationship (see Fig. 16.9a). 


(a)-OBSERVEO RELATIONSHIP (5)-EMPIRICAL RELATIONSHIP — (c)- THEORETICAL RELATIONSHIP 


Fic. 16.9. (а) Graph of observed data; (b) graph of a “smoothed curve"; (с) 
graph of a theoretical curve. (After Engineering and Scientific Graphs for Publication, 
1943, with kind permission of the American Society of Mechanical Engineers.) 


Plotting the observed relationship does not usually yield a smooth, 
sweeping curve. Some believe this is due to an insufficient number of 
measurements because the addition of more subjects, cases, or measure- 
ments will often do away with the irregular characteristic of a line graph 
of an observed relationship. One may attempt to smooth an irregular 
curve by drawing a smooth curve over the plotted points. This is calle 
smoothing a curve by eye (see Fig. 16.9b). 

One may attempt to smooth the observed relationship by some smooth- 
ing technique such as a form of the “method of moving averages.” 
Here, one averages the ordinate values for the first, second, and thir 
plotted points on the graph, and plots this average; then one average 
the ordinate values for the second, third, and fourth plotted points, 2P 
plots this average, ete. Опе may then connect the points representing 
the running averages of the plots, and secure a smoother curve. 

A third method of smoothing a curve is to superimpose on the obser 
relationship a theoretical curve that has been previously shown to repre 
sent the total population for which the present data represents à samp? 
(see Fig. 16.9c). 

A theoretical curve is usually drawn by substituting values into ё 
formula representing the relationship of the abscissa to the ordinate. e 


ved 
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psychologi i i 

iun v a di wishes to fit a “normal curve" on his observed 

b ї tey аге in the form of а frequency poly; i 
pom direct statistical нала ОРА 

аг i 
can А jm "i Ps a of smoothing observed data, one should never 
ai к RM 
у паннай i natal rve without also indicating the curve of the 


The Normal Curve 


Nor ; 

which ee ды 2 name applied to a particular bell-shaped curve 
аав uf wera S y plotting the frequency of occurrence of successive 
pandeni aud y а А е whose variations appear to be due to a number of inde- 
онна to уш cay om conditions. It has been found that when a factor is 
sols in-the E in a chance manner—such as tossing a large number of 
tails that a ir repeatedly and recording all combinations of heads and 
отв. are ds E шен the outcomes of the chance variations of the fac- 
given the E ed on a coordinate system, a curve whose shape has been 
that e normal curve will be approximated. It has been found 
ar to the d in some psychological traits produce a curve simi- 
other бонӣ тта] curve. By normal curve, we do not mean that any 
ing our date i үс 18 abnormal or that we have made mistakes in collect- 
ormed a c if we do not arrive at it. We simply mean that our data have 
ү е ‘Stared? ae having the characteristics of the curve we call normal. 
irection) ae has its point of inflection (point at which it changes 
ig. 12.4 ) i sigma from the mean. (See drawing of normal curve in 
This mu : n addition, the normal curve is asymptotic to the base line. 
i imd kat it continues to approach but never reaches the base line. 
adds ads de is approximately six standard deviations wide. If one 
mal curve rai three standard deviations from the mean of a nor- 
Per cent) ; he nearly marks off the extremes of the distribution (99.73 


Hint 
5 
Ты for Constructing Graphs 
is n 
ё кас ш, that certain principles b 
ruction of graphs if standards for neatness, 


cabil; 
My are desired.! 
e ial i i 
remaining pages of this chapter let us discuss the requirements 


or 

., Bood 3 2 

Mherent mum construction. There are at least six interrelated topics 
n a discussion of graph construction; these are (a) helping the 


e accepted and maintained for 
clarity, and practi- 


3 sponsored a publication 
The author has drawn 
heir permission to 
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ily oti eee and Scientific Graphs for Publication.” 
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reader to understand the graph, (b) the coordinates, (c) the selection of 
scales for the coordinates, (d) the curve itself, (е) the lettering and line 
width, and (f) the title of the graph. Each of these points will be dis- 
cussed separately. 

Helping the Reader to Understand the Graph. Any graph should present, 
to the reader, information as accurately, clearly, directly, efficiently, and 
helpfully as possible. To do this, itis necessary to make a special appeal 
to the particular reader for whom the graph is primarily intended. 
good rule to follow is to construct your graph so simply that it will be 
understandable to the most naive person who might have need of under- 
standing the information contained init. Engineers should not construct 
graphs so that only their fellow graduate engineers can understand them, 
but should see to it that the graph has an appeal to all persons who, in 
their pursuits, might have need of the information. So it is with psy- 
chologists, where esoteric symbols and phrases coupled with decorative, 
clever, and unusual labels and drawings have no place in a graph. How- 
ever, if certain abbreviations are common in the field and there is а need 
for saving space on the graph, then there is no objection to their use. 

The size of a graph should be relative to its importance in the study 
where it appears. Large graphs presenting minor information and small 
graphs presenting major information may convey a false and confusing 
impression to the reader. This point and many similar ones of “ psycho- 
logical” importance should be thought about by the person constructing 
the graph, and he should attempt to include only the ideas and use only 
the methods of presentation that will aid the reader in receiving the 
desired impression of the significant information revealed. 

Save your reader as much work in interpreting the graph as you can by 
using a form of presentation familiar to him. In addition, there shoul 
be a minimum of nonessentials included in the graph. Particularly 
should an attempt be made to keep all data, lines, scale divisions, nova 
tions, formulas, and lettering to a bare minimum. Figure 16.10 reveals 
how a cluttered graph (а) is simplified to a clear graph (b) by removiné 
extraneous materials. 

Rectangularly shaped graphs are recommended for two reasons: (a) 
graphs drawn on a rectangular pattern so that the width of the rectang ? 
is approximately 75 per cent of the length will allow, on the average 
correct representation of the relationship between the variables in terms 
of relative proportion in size, and (b) rectangles of this length and wi 
present a more pleasing appearance in print, whether placed vertically oF 
horizontally on the page. 

Often it is necessary to include more than one curve on a single graph. 
This may be done, but usually it is advisable to place no more than fot 
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(а)-А GRAPH OVERLOADED WITH LINES АМО LETTERING 
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TABLE, ETC. 
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Gha i a ier 1. (After Engineering and Scientific 


y of Mechanical 


Grapp, - Simplificati 1 of materia " E 
‘Dh mplification by remova П » 
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e 

m 9n the same graph unless they do not cross one another and are 
Separated, | Nem. 

| * Coordinates. In addition to the abscissa and ordinate itis de 
clude what are called coordinate rulings. Coordinate rulings а 


“tional lines placed on the graph that will guide the reader’s eye oe 
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a point on a curve to its scale values on the abscissa and ordinate. If the 
graph is to be used as a means of accurately relating values on the 
abscissa to values on the ordinate, then it may be desirable to use many 
closely spaced coordinate rulings. However, in graphs where just the 
general function or relationship of one variable to another is represented 
by the curve, then as few coordinate rulings as needed should be 
included. 

The coordinate rulings should form rectangles instead of squares. The 
rectangles may or may not have their lengths and widths positioned in а 
manner corresponding to the length and width of the whole graph. 

Selection of Scales for the Coordinates. Scales are placed along the 
abscissa and ordinate so that the distance along either corresponds to 
some value of the variable. The scales used are in reference in the meas- 
urement of the variables. The independent variable is usually placed on 
the abscissa and its scale values should increase from left to right. The 
dependent variable, then, is placed on the ordinate and increases in scale 
value from bottom to top. If there are to be included two related curves 
on one graph, each having a different vertical scale value, then one 0 
these scale values should be placed on the left-hand side and the other 0n 
the right-hand side. 

Different choices of scale values for graphs of the same relationship will 
produce graphs of different appearance. False impressions may d 
created as to the relationship between the independent and dependent 
variables if the scale values are not judiciously selected (see Fig. 16.11). 

In order to simplify the numbering of the scale units, one should let 
each unit, represented by a coordinate ruling, correspond to a value of 10, 
100, 1,000, etc. Each scale should be identified by a caption indicating 
the variable measured, and the unit of measurement used, for example: 
“Аре in Years." 

The Curve Itself. A single curve should be drawn as one continuous 
solid line. If more than one curve is drawn on the same graph, then tW° 
procedures may be used: (a) if one of the curves is more important tha? 
the others, then it should be of a solid line and the others should be 022 
posed of dotted lines, or of lines drawn lighter than the major curve; 
if more than one eurve is drawn on the same graph, and the curves repre" 
sent a series of observations, then symbols should bé placed on each curve 
that would help to identify it (see Fig. 16.12). Naturally, the differe” 
symbols used to differentiate the curves and identify them should them 
selves be identified by use of a key placed preferably in an isolated аро, 
within a space cleared in the grid system. If only one or two curves r 
drawn, it is better to identify them by labels rather than by geome y 
symbols. Arrows may be used to connect a label with a curve: 


THE CONSTRUCTION OF GRAPHS 177 


POOREST 


ng and Scientific Graphs for Publi- 


Fio, 16 11 
iely of Mechanical Engineers.) 


o 
саң, D А s 
tion, 1 Effect of choice of scale. (After Engineeri 


948, with с 
» with kind permission of the American Soci 


fa). (b)-FILLED-IN CIRCLES ARE COMMONLY PREFERRED FOR 
Fi CHOICE or sy; SCATTER DIAGRAMS, WHERE OBSERVED POINTS ARE 
Magus ia RELATIVELY IMPORTANT FEATURE 

observed points. (After Engineering and 
th kind permission of the American Society 


Scie 16.19 
of пие Gg le for designating 
chanical hea 1948, wil 


178 INTRODUCTION TO EXPERIMENTAL METHOD 


arrows should be used sparingly and placed so as to give a pleasing 
appearance. 

Line Width and Lettering. Line width may be varied so as to indicate 
the relative emphasis to be placed on a particular curve. The curve 
should be drawn as the widest line on the graph, the abscissa and the 
ordinate next widest, and the coordinate rulings should be narrowest. 
As the number of curves on a single graph increase, the width of the lines 
used for the curves should decrease. Exceptional care should be exer- 
cised to avoid drawing lines of any kind on the graph through any plotted 
points, designations, notations, keys, lettering, etc. 

The lettering on the graph should 
be of a simple easy to read variety 
such as the so-called vertical gothic 
capital, and should be of uniform size 
and spacing throughout the graph. 
It is recommended that the lettering 
be done with the help of a commer 
cial lettering guide. Although typ® 
stamping is sometimes successfully 
used to produce lettering in publishe 
works, graphs should not be lettered 
by use of the ordinary typewriter: 
All writing on and around the graph 
should be so placed as to enable the 
viewer to read it from the right-han 
side and bottom of the page. Graphs 
designed to be read from the left side 
or from the top of the page are ud 
only unpleasing in appearance bu 
Fia. 16.13. Lettering for full page cumbersome in use (see Fig. 16.13): 


illustration. (After Engineering and М yaphs 
Scientific Graphs for Publication, 1049 Title of theGraph. Titles of g "i 
with kind permission of the America, SHOuld be so self-explanatory ? 


Society of Mechanical Engineers.) make almost unnecessary the reading 

Е р of the particular part of the [е 
wherein the graph is discussed. The title should be preceded by а figur? 
number which refers the reader from the written material to the graph © 
from the graph to the written material. Figures should be numbere 
consecutively throughout the text, 

The title should contain as much of the following information about im 
curve as needed: (a) a statement of the independent and dependent varia 
ble, for example, Effects of Practice on Performance; (b) it shou d 
stated whether the curve plotted is based on raw or statistically 168° 
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data. RSS 

| © oci Means Scores by Trial for the Experimental and Con- 
Bat heben m анд Intervals throughout the Series of Tests; (c) indi- 
oe ете аш үе is based on data from one set of measurements or 
Fa бурур series of measurements, for example, Combined Errors at 
тл et for All Subjects Who Reach the Criterion; (d) indicate 
К ре, Dia 2 jects, or separate measurements, yielding the data, for 
om. (o) is €— of Score Made on a Judgment Test by 1,000 
graph b. he arify the meaning of any separation or division made in the 
Three a ш, Prerest and Postrest Median Performance under the 
with, or а pue Conditions; (f) indicate if the curve is compared 
qu Groth to, a theoretical curve, for example, Distribution of Intelli- 
5 9 P on 2,000 Men and Women Compared with a Normal 
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could easily occur by chance fluctuation even if there were no significant 
differences or significant relationships. Perhaps he found that only once 
in one hundred times could he expect such differences or relationships to 
occur by chance. If the latter were true, he feels that the odds are in his 
favor if he affirms a significant difference in his dependent variable as 
related to the presence or absence of the independent variable. With the 
chances of being wrong only once in a hundred times, he may not hesitate 
to affirm a positive or a negative relationship between his independent and 
dependent variable. He has already learned the inherent errors in draw- 
ing causal sequences. He may find that his conscience rests easier if he 
speaks only of the degree of the relationship and couples it with a state- 
ment of the level of confidence it has earned. 

He must remember that he has only been dealing with a sample of the 
thing under observation. He may have picked out the only piece of 
garlic in the pot of soup. It is not wise for him to generalize outside the 
confines of his experiment. If he includes, as a prefixion to his conclu- 
sions, a statement to the effect that within the limits imposed by the 
research design the following conclusions appear warranted, he does not 
himself go outside the bounds of his sample. Others may extrapolate 0” 
the results and conclusions, but they do so at their own risk, not his. 

Often, in fact almost invariably, new hypotheses suggest themselves 
or better means for testing the present hypothesis are discovered, 85 i 
result of his experiment and experience with the problem. This type of 
contribution for the edification of other experimenters in the field shou 
most certainly be reported by an experimenter. 

The simplest answer is the best. So it was in the statement of the 
hypothesis and so it is in the statement of generalizations from the results: 
The experimenter must constantly guard against "reading into" the 
subject’s behavior. Partieularly is it important to keep the level 0 
explanations at the level of the subject. If the experimenter has per 
Тайпей a study using rats as the experimental animals, he should make 
енні m he remembers he used rats. He should Bof draw inference 
concerning the rat’s behavior that depend upon any characteristic, trait 
or structure of the rat for their validity unless he is positive that the Е 
has such capacities. The author is reminded of а fairly recent PSYC” , 
analytic study that dealt with interpreting the behavior of a pussycat that 
kept attempting to crawl into a drain spout. The behavior was inte 
preted as caused by a “death wish” on the part of the pussycat. һе 
seemed to the author that it is more likely that this was projection oft : 
interpreter's own idea of what he might be wishing if he crawled in y 
drain spout. Perhaps Lloyd Morgan summed it all up in his famous 18 А 
of parsimony wherein he said, “In по case may we interpret an action 
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the outcome of the exercise of a higher psychical faculty, if it can be inter- 
preted as the outcome of the exercise of one which stands lower in the 
Psychological scale." This law particularly applies to the anthropo- 
morphic tendency in interpreting animal behavior. Sometimes, in the 
Interest of new hypotheses, the law may be broken, but it should still be 
kept on the statute books. 
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PORT OF TWO WELL-WRITTEN EXPERIMENTS 


с The write- 

similar бск or of two : hypothetical experiments follow. They are 
variable, but E " deals with the span of apprehension as the dependent 
method | hens iio in that the first experiment is conducted under a 
Variation oo design and the second under a method of concomitant 
an ES ы qu The student who wishes to plan, execute, and report 
hese Sio: a under either one of these types of design will find that 

ups provide him with an easily followed guide. 


Ета : 
mple of an Experiment Planned, Conducted, and. Reported 
under а Variation of the Method of Differences 
Type of Design 
Name: John Doe 
Section: Monday, 10:00 ^. м. 
Date: 24 Seplember, 1951 
Wh Form for Planning or Reporting Experimentation 
уа the problem? 
is Piera e of apprehension of numbers greater when an individual 
vidual ^. y set to recall them from left to right 
2 tate i set to recall them from right to left? . 
he problem in terms of а hypothesis. 
t significantly greater 


The 
When m an of apprehension of numbers is no 
n individual is mentally set to recall them from left to right 


алуу 
owed the individual is mentally set to recall them from right toleft. 
can be а Span of Apprehension. The number of objects that 
аз to ex үе or correctly apprehended during an exposure so short 
Set, By ude eye movements. L-R will refer to left to right mental 
* What tara refer to right to left mental set. 
em he independent variable? 
ar rang set of the individ ual to recall the numbers under @ particu- 
Tom lef in. of apprehension. mental set to recall 
9 reca] to right, as compared with t! ondition of being set 
* Whati | from right to left. 
1s the dependent variable? 
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than when the indi- 
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The length of the span of apprehension. 
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Specifically, the number of 


digits the subject immediately recalls under each of the two condi- 
tions of the independent variable. 
5. How is the dependent variable (s) to be measured? 
By observing and recording the number of digits the subject can 
correctly recall under each condition of the independent variable. 


SAMPLE TABLE то BE USED IN THE COLLECTION or THE DATA 


Set L-R 


Set R-L 


Number of digits 


el correctly recalled | Таш uem ж. 
1 | 1 
6. What controls are necessary? 
What? | How? 


1. Extraneous light and 
sound stimuli 


2. Exposure time for the 
numbers to be 14 second 

3. Order of alternation of 
set assumed by subject 


4. Orders of numbers in the 


series presented 
5. Fixation point 


6. Ready signal 


7. Usual set of subject in 
apprehending the written 
material 


8. Visual acuity 


| 
ILightproof and sound- 
deadened room 
(method of removal) 
Shutter attachment for 
projector 
Counterbalancing method 
(R-L, L-R, and L-R, R-L, 
ete.) 
Systematic randomization 


Spot of light projected on 
screen so as to locate for 
the subject the area of the 
screen on which the digits 
will be projected 


Sound buzzer just before 
presentation of digits 


Choose subjects who do 
not have familiarity with 
reading Yiddish or 
Chinese 

Must have 20-20 vision 
without glasses 


Why? 


To exclude interference 
from uncontrolled 
stimuli . i 

To maintain uniformity 0 
stimuli presentation 

To avoid constant errors 
due to fatigue and prat- 
tice effects 

To avoid repetition of same 
sequence of numbers 

To allow the subject to л 
have his eyes focused б 
the important area of thi 
screen so that he will be 
able to have maximum 
opportunity for appre- 
hending digits 

To азе subject digits Е 
about to be presented се 
that he should be fixat! 
on the screen 

Persons who read 
instead of L- may 
the former set 


from nb 


favor 


ight, 
To ensure normal ай 
and avoid variable 0 
dirty glasses, refle! 


and eye strain 
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id m he procedure to be followed in conducting the experiment? 
n. Nm of a method of difference design. 

agram the apparatus. 
e pom will contain sets of numbers varying from 2 to 11 digits. 

EN wenty complete sets of slides will be used. 

escribe exactly what you plan to do. 
a subject will be seated and instructed as to the purpose of 
iei arci All questions concerning the experiment will be 
- à . No written instructions will be used. The subject 
tion е суне 12 feet from the screen and below the line of projec- 
Thre ‘he projector should be focused to the subject’s approval. 
mid slides, not to be used in the experiment proper, will be pro- 
i ^s to accustom the subject to the procedure. The slides dur- 
лен experiment proper will be presented so as to increase the 
slide er of digits by one digit, each trial, starting with a two-digit 
iis and increasing until the subject fails to accurately report on 

o slides in series. The highest number of digits he reports cor- 


ti is his digit span for that series. The subject will be 
structed to change his mental set for each presentation of a new 
R-L, R-L, L-R, L-R, R-L, 


EN of slides in the following order: Г-К, 
» L-R. А 15-second interval will be maintained between the 
presentation of two slides in a series, and а ]-minute interval will 
© maintained between the presentation of any two series of slides. 
о е subject will be given 10 trials under each of the 2 conditions 
Dar set. A different set of slides will be used in each of the 

x ai Exposure time for each slide will be 14 second. 
о you plan to analyze the research results? 


, The significance of the difference between the subjects mean 
d to his mean digitspan 


тэ Span under the L-R set as compare › 

er the R-L set will be determined by a test. A graph showing 

Bu esult of each direction of set as it is related to the digit span n 
3 Revie series will be constructed. 

W the research design. e 

at results, were they obtained, would support your hypothesis? 

ia no significant difference at the 1 per cent level is Run 

о ween the means of the two digit spans, then it will be ta ш 

а indicate that the direction of the set of the individuals is no 

s Bnificantly important variable in its relation to digit span. 

b, Е results would force ће acceptance of the null hypothesis. 

hy + results, were they obtained, would fail to support your 

Dothesis? ы 

a significant difference exists between the two mean digi 
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spans significant at or above the 1 per cent level of confidence, then 

it will be felt that such a difference is not due to chance fluctuation 

but represents the influence of a variable, most likely, the direction 

of the set of the individual. If such results are obtained, the null 
hypothesis will be rejected. 

9. Conduct the experiment. 

а. What unplanned occurrences were present that may have influ- 
enced your results? 

The projector bulb burned out during trial 3 under the set L-R. 

It was immediately replaced without the need for illuminating 


the room. 


The subject sneezed during trial 4 under the set L-R. The 


three digit slide was projected a second time for him. 


T ro 
Taste 1. Tur Numper or Diairs Correctiy RECALLED UNDER ЁАСН OF THE Tw 
Conpitions or Мехтар Ser 


Set L-R Set R-L 

жы Жынсы | isa | Жат 
1 5 1 4 
2 5 2 4 
3 6 3 3 
4 6 4 4 

5 6 5 4 ! 
6 5 6 3 

7 7 7 3 H 
8 7 | 8 3 
9 6 | 9 4 
10 7 | "m 3 


b. What were your subject’s reactions to the experiment (rem? 


attitudes, ete.)? 


Reported difficulty in maintaining a R-L set. o. 
"Tried to light up a cigarette but was not permitted to dos 


rks) 
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Subjec i 
ject seemed anxious to cooperate at first, but looked at his 


е : 
А bee the last half of data collection. 
arize your research results in tables, graphs, 
ar means of presentation. 


== 


2—28 
KT 


bns. | | DIGIT SPAN 
18.1. Relationship of digit span to direction o! 


and/or other 


f mental set. 


10, 
"i-i the results. 
win. your tables and graphs from 
Ач pi ы ү hypothesis. 

the va an in Fig. 18.1 shows a fairly large difference between 
vede Sodio of mental set as regards digit span. On the 

the L-R his graph, one can see a numerical difference 1n favor of 
mental set as being more conducive to a longer digit span. 

t the 


In indi i 
terms of bare means as indicated in Table 2, we see tha 


the point of view of proving 


Tay 
LE 2, 
RESULTS оғ STATISTICAL MANIPULATION or rHE DATA IN Tape 1 
Set L-R | Set р 
" 10 10 
= 6.0 3.5 
S.E.p 307 
D 2.5 
Level of "d 
t 
t teutre ты ле = 1% (much beyond) 
% : 9r significance at: 
1% level dence 2.10 | 
of confidence 2.88 
Superiori | 
к of the L-R mental set over the R-L mental set 18 2.5 
ш re digits recalled correctly. The t of 8.14 between these means 
Several times larger than necessary for significance at the one 
r the L-R 


ре 
nis level of confidence. в 
is noted that the subject Was more variable unde 
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mental set than under the R-L. However, this difference in varia- 
bility may not be significant. 

In summary, these data reveal a superiority of the L-R set over 
the R-L set significant beyond the 1 per cent level of confidence. 
The data gathered in this experiment offer no support for the 
acceptance of the null hypothesis. On the contrary, so far as 
these data are concerned, the rejection of the null hypothesis is 
demanded. 

b. State your conclusions. \ 

Within the limits imposed by the research design the following 
conclusions appear warranted: 

(1) In this experiment it has been demonstrated that the subject 
accurately recalled significantly more digits under a mental set 
L-R than under a mental set R-L. 

(2) Further work might be undertaken to investigate the reason 
for the greater variability of the subject’s recall under his more 
familiar L-R mental set than under the less familiar mental set. 
The operation of greater attention under the unfamiliar mental 
set is hypothesized as a possible answer, 

(3) It must be noted that although the difference obtained under 
the two conditions of mental set was highly significant, only one 
subject and a series of only ten trials was used. Whether the 
rejection of the null hypothesis would hold true as a generality 18 
as yet unknown. 


Example of an Experiment Planned, Conducted, and Reported 
under a Method of Concomitant Variation Type of Design 


Name: John Doe 
Section: Monday, 10:00 А.м. 
Date: 1, October, 1951 


Form for Planning or Reporting Experimentation 


1. What is the problem? = 
Is there a relationship between the amount of practice one bas Е 
apprehending numbers and his span of apprehension? 
2. State the problem in terms of a hypothesis. ; 
"There is no significant relationship between the amount of practi’? 
one has in apprehending numbers and his span of apprehension. t 
Definition of Span of Apprehension. The number of objects th# 


can be perceived or correctly apprehended during an exposure 80 8 р 
as to exclude eye movements. 
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нна | е | Ee number of times the individual has his 
A E on calculated will be taken as the amount of prac- 
3. Е is the independent variable? 

Р ch ace of practice the subjects have in determining their spans 

E. Er One determination of a subject’s span of apprehen- 

ЖЫ н на one unit of practice, two determinations constitute two 
4. What; practice, etc. 

2 is the dependent variable? 

die hi of the span of apprehension. Specifically, the number of 

веб he subjects immediately recall under various amounts of 
5. cde 

"er is the dependent variable (s) to be measured? 

iie and recording the number of digits the subjects can 

и recall under various conditions of the independent variable. 

A’s span will be based on one trial, Subject B’s on his second 


tri : 
lal, and subject C on his third trial, ete. 


SAMPLE TABLE ro Br USED IN THE COLLECTION OF Data 


Subject Number of Span of apprehension 


trials 
— = eS ERE 
A 1 
B 2 
С 3 
i eee al 
| 


6. үү 
7 me controls are necessary? 
жү the procedure to be followe 
ation of the method of concom 
б) eae the apparatus. 
(2) Slides will contain sets of 
Ten complete sets of slides will be n 
escribe exacily what you plan to do. 

The subject will be seated and instructed as to the purpose of 
the experiment. All questions concerning the experiment will be 
answered. No written instructions will be used. The subject 
Will be seated 12 feet from the screen and below the line of projec- 
Don. The projector should be focused to the subjects approval. 
Three slides, not to be used in the experiment. proper, will be pro- 
lected to accustom the subject to the procedure. The slides dur- 


d in conducting the experiment? 


а itant variation design. 
numbers varying from 2 to 11 digits. 
eeded. 
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What? 


1. Equation of subjects as to 
span of apprehension 


- Control of mental set, of 
subjects 


. Extraneous light and 
sound stimuli 

- Exposure time for the 
numbers to be 14 second 

- Order of numbers in the 
Series presented 

. Fixation point 


- Ready signal 


. Usual set of Subject in 


apprehending the written 
material 


. Visual acuity 


rectly is his digit 


slide will be 14 second. 
Each subject will have his вр: 
tained in the manner described. 


span on this first d 
subjects so chosen 
determining their 


Use only subjects who 


Lightproof and sound- 


Hi ow? 


have span of apprehen- 
sion of 6 digits on first 
determination 


Use mental set of left to 
right in determining span 
of apprehension 


deadened room 

Shutter attachment for 
Projector 

Systematic randomization 


Spot of light projected on 
Screen so as to locate for 
the subject thearea of the 
Screen on which the digits 
will be Projected 


Sound buzzer just before 
Presentation of digits 


Choose Subjects who do 
not have familiarity with 
reading Yiddish or 
Chinese 

Must have 20-20 


- vision 
without glasses 


, each trial, 
subject fai 
The highest numb 
span for that Series, 
ап of ap 

The 


10 
etermination will b, 


e ch: 
will be given different 
span of apprehension. 
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Why? 


To exclude individual 
differences in length of 
span of apprehension, 
which might be аша as 
tially affected by practic 

To exclude influence of 
direction of mental set, d 
and keep data comparab! 
among subjects 

To exclude interference Т 
from uncontrolled ваши 

To maintain uniformity 0 
stimuli presentation 

To avoid repetition of same 
sequence of numbers 

To allow the subject to 
have his eyes focused on 
the important area of t 
screen so that he will be 
able to have maximum 
opportunity for appre- 
hending digits 

To veni вон digits E 
about to be presented an 
that he should be fixating 
on the screen L 

Persons who read from R= 
instead of L-R may favor 
the former set 


To ensure normal sight, 
and avoid variable of 


Xposure time for each 


Prehension Ғор digits ascer- 
subjects having the same 
chosen for the study. The 


amounts 


of practice in 
Subj ect 


A will only be 
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eat d trial, his equating determination, Subject B, two trials 
72и 4 eterminations of his span of apprehension, Subject C, 

rials, etc. 
c. Eoy do you plan to analyze the research results? 
uro “оң product-moment coefficient of correlation will be 
аар i ai the data representing as (X) the number of practice 
iene n (Y) the span of apprehension for each subject. The 
Богу ing r will be tested for significance from a zero correlation 
the ne the two variables. A graph will be constructed showing 

Š: Revie, relationship of practice to span of apprehension. 

A у the research design. 
- What results, were they obtained, would support your hypothesis? 
If there is no significant relationship between the amount of 
En and span of apprehension as revealed by а coefficient of 

it re ation significant at less than the 1 per cent level of confidence, 

it will be felt that no relationship exists between the two variables 
other than could be explained by chance fluxation. Thus the 
lack of a significant relationship will force the acceptance of the 


" null hypothesis. 
- What results, were the; 
hypothesis? 

_ Tf a significant 
tice and span of apprehen: 
per cent level of confidence t 
ship exists in the direction determine 
of correlation. In such a case, the п 


rejected. 


y obtained, would fail to support your 


relationship exists between the amount of prac- 
sion significant at or above the one 
hen it will be felt that a true relation- 
d by the sign of the coefficient. 
ull hypothesis would be 


APPREHENSION OF THE SUBJECTS UNDER VARIOUS AMOUNTS 


Tap 3 
LE 3. Tue SPAN OF 
or Practicp IN DETERMINING THEIR SPAN OF APPREHENSION 


Number of Span of 
Subject determinations apprehension 
A 6 
B Т 
G 7 
7 10 11 
iment: 


9. Conduct the exper 
a. What unplanned occurrences were present that may have influ- 


enced your results? 
One subject who was given eight practice determinations asked 
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т required for significance at: 


- What were your subject’s reactions to 


. Summarize your resea 
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em <cused after 
if he were “dumber” than his friend who had been excused а 
having been given only two practice trials. 


the experiment (remarks, 
attitudes, etc.)? 


Those subjects given the greater number of trials became een 
The experimenter attempted to keep their attention on the es 
without introducing a variable of increased motivation by 
attempts. 


r other 
rch results in tables, graphs, and/or ot 


clear means of presentation. 

TABLE 4. RESULTS or STATISTICAL MANIPULATION OF THE DATA 
N =10 
т = .96 


5% level of confidence .632 
1% level of confidence -765 


SPAN OF APPREHENSION 
(Number of digits) 


tions of. Span of apprehension) 


Fic. 18.2. actice to span of 


Relationship of pr: apprehension. 


10. Interpret the results. 


a. Discuss your tables and gra 


phs from the point of view of proving 
or disproving the hypothesis. 


The graph in Fig. 18.2 shows a strong trend for a lengthening 
of the span of apprehension of digits when Opportunity for addi- 
tional practice in determining the Span was provided, When ® 
coefficient of correlation was calculated, į 
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we have evidence supporting a rejection of our null hypothesis 
and the acceptance of the statement that in this experiment, 
practice was significantly and positively related to the span of 
apprehension. 
- State your conclusions. | 
Within the limits imposed by the research design the following 
conclusions appear warranted: А 
(1) As one increases the amount of practice afforded to subjects 
in determining their span of apprehension, the span of appre- 
hension is significantly increased. . 
(2) It is suggested that future research aimed at checking these 
results should not only include a larger number of subjects but 
also should include a technique of design as control that would 
aid in counteracting the influence of a change in motivation during 
the experiment which may have influenced the results. However, 
if a decrease in motivation occurred in this experiment, then the 
results of this experiment are even more significant in favor of 
the influence of practice. 
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TABLE 
А. TABLE or SQUARES AND Square Roots or NUMBERS FROM 1 то 1,000* 


Number Square Square root | Number 
1 1 1.0000 41 
2 4 1.4142 42 
3 9 1.7321 4 
4 16 2.0000 44 
5 25 2.2361 45 
6 36 2.4495 46 
7 49 2.6458 47 
8 64 2.8284 48 
9 81 3.0000 49 

10 100 3.1623 50 
il 121 3.3166 51 
12 14 3.4641 52 
13 169 3.6056 53 
14 196 3.7417 54 
15 225 3.8730 55 
16 256 4.0000 56 
17 289 4.1231 57 
18 324 4.2426 58 
19 361 4.3589 59 
20 400 4.4721 60 
21 441 4.5826 61 
22 484 4.6904 62 
23 529 4.7958 63 
24 576 4.8990 64 
25 625 5.0000 65 
26 676 5.0990 66 
27 729 5.1962 67 
28 7 84 5.2915 | 6 
29 841 5.3852 69 
30 900 5.4772 70 
31 961 5.5678 71 
32 10 24 5.6569 72 
33 10 89 5.7446 73 
34 1156 5.8310 74 
35 1225 5.9161 75 
36 12 96 6.0000 76 
37 13 69 6.0828 77 
38 14 44 6.1644 78 
39 1521 6.2450 n 


* Portions of Table A have been reprodu 
Handbook of Statistical Nomographs, Tables, 
New York (1932), by permission of the authors. 


Square 


1681 
17 64 
18 49 
19 36 
20 25 
2116 
2209 
23 04 
2401 
2500 


2601 
2704 
28 09 
29 16 
3025 
3136 
3249 
33 64 
34 81 
36 00 


3721 
3844 
39 69 
40 96 
42 25 
43 56 
44 89 
46 24 
47 61 
49 00 


5041 
5184 
53 29 
5476 
56 25 


Square root 


6.4031 
6.4807 
6.5574 


Qo оо 00 00 00 со со со со 00 
M go: poit 
t 
E 


ced from J. W. Dunlap and A. K. Kurtz: 
and Formulas, World Book Company, 
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TABLE А. TABLE or Squares AND Square Roors or NUMBERS 
FROM 1 TO 1,000.* (Continued) 


Number Square Square root | Number Square Square root 
81 65 61 9.0000 121 14641 11.0000 
82 67 24 9.0554 122 148 84 11.0454 
83 68 89 9.1104 123 15129 11.0905 
84 70 56 9.1652 124 153 76 11.1355 
85 7225 9.2195 125 15625 11.1803 
86 73 96 9.2736 126 158 76 11.2250 
87 75 69 9.3274 127 16129 11.2694 
88 77 44 9.3808 128 16384 11.3137 
89 7921 9.4340 129 16641 11.3578 
90 81 00 9.4868 130 16900 11.4018 
e 8281 9.5394 131 17161 11.4455 
* 84 64 9.5917 132 17424 11.4891 

8649 9.6437 133 17689 11.5326 
94 88 36 9.6954 134 17956 11.5758 
95 90 25 9.7468 135 18225 11.6190 
96 92 16 9.7980 136 18496 11.6619 
97 94 09 9.8489 137 187 69 11.7047 
98 9604 9.8995 138 190 44 11.7473 
99 98 01 9.9499 139 1.7898 
ш Moon 10.0000 140 1 2500 11,8522 
101 10201 10. 
102 10404 ase и 198 81 iae 
103 10609 10.1489 143 20164 п. 583 
104 10816 10.1980 144 20449 а 
105 11025 10.2470 145 20 A 6 
106 11236 10.2956 146 21025 12.0416 
107 11449 10.3441 if 213 16 12.083 
108 1166 10.3923 is 21609 12.1244 
109 11881 10.4403 14 21904 12.1655 
110 12100 10.4881 150 22500 ТОЛ 
12. 
111 12321 10.5 
112 12544 es i 22801 12.2882 
13 12769 10.6301 153 О 12.2285 
114 12996 10.6771 154 Suo 12.3693 
115 13225 10.7238 155 23716 12.4097 
116 13456 10.7703 156 2 40 25 12.4499 
117 136 89 10.8167 157 24336 12.4900 
118 13924 | 10.8628 | 158 24649 | 12.5300 
119 14161 10.9087 159 ee 12.5698 
120 1400 10.9545 160 np ed 
12. 
* Portions of Table А have been reproduced from J. w у ——————— 


Handbook of Statistical Nomographs, Tables, and PULO Slap and А. К. Kurt: 
New York (1932), by permission of the authors, > World Book Company: 
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TABLE A. TABLE or SQUARES AND Square Roors oF NUMBERS 


* Portions of T 


Handbook 
New York 


of Stati 
(1932), 


ғвом 1 To 1,000.* 


Square 


25921 
26244 
265 69 
2 6896 
27225 
27556 
27889 
28224 
28561 
2 89 00 


29241 
29584 
29929 
302 76 
30625 
3 09 76 
31329 
31684 
32041 
3 2400 


32761 
33124 
33489 
3 38 56 
3 4225 
3 45 96 
3 49 69 
35344 
35721 
3 6100 


36481 
3 68 64 
37249 
3 76 36 
3 8025 
38416 
3 88 09 
39204 
39601 
40000 


Square root 


12, 
12. 
12. 
12. 
12. 
12. 
12. 
12. 
13. 
13. 


135 
13. 
13. 
13. 
132 
18: 
13. 
13; 
3791 
4164 


6886 
7279 
7671 
8062 
8452 
8841 
9228 
9615 
0000 
0384 


0767 
1149 
1529 
1909 
2288 
2665 
3041 
3417 


.4536 
.4907 
.5277 
.5647 
.6015 
.6382 
.6748 
‚7113 
‚7477 
.7840 


.8203 
.8564 
.8924 
.9284 
.9642 


(Continued) 
Number Square 
201 40401 
202 40804 
203 41209 
204 41616 
205 42025 
206 424 36 
207 4 28 49 
208 43264 
209 45681 
210 44100 
211 44521 
212 44944 
213 453 69 
214 4 57 96 
215 4 6225 
216 4 66 56 
217 4 70 89 
218 47524 
219 479 61 
220 4 84 00 
221 48841 
222 492 84 
223 497 29 
224 501 76 
225 50625 
226 51076 
227 51529 
228 51984 
229 52441 
230 52900 
231 533 61 
232 53824 
233 54289 
234 547 56 
235 55225 
236 55696 
237 5 6169 
238 5 66 44 
239 57121 
240 57600 


Square root 


14.1774 
14.2127 
14.2478 
14.2829 
14.3178 
14.3527 
14.3875 
14.4222 
. 14.4568 
14.4914 


14.5258 
14.5602 
14.5945 
14.6287 
14.6629 
14.6969 
14.7309 
14.7648 
14.7986 
14.8324 


14.8661 
14.8997 
14.9332 
14.9666 
15.0000 
15.0333 
15.0665 
15.0997 
15.1327 
15.1658 


15.1987 
15.2315 
15.2643 
15.2971 
15.3297 
15.3623 
15.3948 
15.4272 
15.4596 
15.4919 


by permission of the authors. 


able A have been reproduced from J. W. Dunlap and A. K. Kurtz: 
istical Nomographs, Tables, and Formulas, World Book Gunner 
, 
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TABLE А. TABLE or Squares AND Square Roots or NUMBERS 


FROM 1 то 1,000.* 


(Continued) 
ee ee 


Number Square | Square root || Number Square Square root 
241 58081 15.5242 | 281 78961 16.7631 
242 5 85 64 15.5563 282 79524 | 16.7929 
243 590 49 15.5885 283 80089 | 16.8226 
244 595 36 15.6205 284 80656 | 16.8523 
245 600 25 15.6525 285 81225 16.8819 
246 605 16 15.6844 286 817 96 16.9115 
247 61009 15.7162 287 823 69 16.9411 
248 61504 15.7480 288 82944 16.9706 
249 62001 15.7797 289 83521 17.0000 
250 625 00 15.8114 290 84100 17.0294 
251 63001 15.8430 291 17.0587 
252 63504 15.8745 292 т a 17.0880 
253 64009 15.9060 293 85849 | 17.1172 
254 645 16 15.9374 294 86436 | 17.1464 
255 65025 15.9687 295 87025 17.1756 
256 6 55 36 16.0000 296 87616 17.2047 
257 6 60 49 16.0312 | 297 8 82 09 17.2337 
258 665 64 16.0624 298 88804 17.2627 
259 67081 16.0935 299 89401 17.2916 
260 67600 16.1245 300 9 00 00 17.3205 
261 68121 16.1555 4 
262 68644 | 16184 | 301 91206 | af aval 
263 691 69 16.2173 303 91809 17.4069 
264 69696 16.2481 304 924 16 17.4356 
265 70225 16.2788 305 93 17.4642 
266 7 07 56 16.3095 306 PS 17.4929 
267 71289 16.3401 307 9 ag ‘5214 
268 71824 16.3707 308 Lew 17409 
269 72361 16.4012 309 "us = 784 
270 72900 16.4317 310 ties И 

96100 17.6068 
271 73441 16.4621 
272 7 39 84 16.4924 ш A 21 epe 
273 74529 16.5227 313 9 = а 8 
274 75076 16.5529 314 92969 | 17.691 
275 75625 16.5831 315 pee aA 127200 
276 76176 16.6132 316 9 38 я а 
277 76729 16.6433 317 оо во | А 2045 
278 77284 16.6733 318 1011 PA 17808 
279 77841 16.7033 319 hare | 1-56 
280 7 84 00 16.7332 320 a 17-8806 


102400 | 17.8885 


* Portions of Table A have been reproduced f, 
Handbook of Statistical Nomographs, Tables, an 


New York (1932), by permission of the authors, 


rom J. W. 
d Г, 


ormulas, Wo 


Dunlap and A, K. Kurtz: 
tld Book Company: 
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TABLE A. TABLE or SQUARES AND SQUARE Roots or NUMBERS 
FROM 1 To 1,000.* (Continued) 


а ые" ee 
Square root 


Number Square Square root | Number Square 
321 10 30 41 17.9165 361 13 03 21 19.0000 
Ea 1036 84 17.9444 362 131044 19.0263 
10 43 29 17.9722 363 1317 69 19.0526 
324 10 49 76 18.0000 364 13 24 96 19.0788 
325 10 56 25 18.0278 365 13 3225 19.1050 
326 1062 76 18.0555 366 13 39 56 19.1311 
327 10 69 29 18.0831 367 13 46 89 19.1572 
328 10 75 84 18.1108 368 13 5424 19.1833 
329 10 82 41 18.1384 369 13 61 61 19.2094 
330 10 89 00 18.1659 370 13 69 00 19.2354 
331 10 95 61 18.1934 371 13 76 41 19.2614 
332 11 02 24 18.2209 372 13 83 84 19.2873 
333 1108 89 18.2483 373 13 91 29 19.3132 
334 1115 56 18.2757 374 13 98 76 19.3391 
335 1122 25 18.3030 375 14 06 25 19.3649 
336 1128 96 18.3303 376 14 13 76 19.3907 
337 1135 69 18.3576 377 142129 19.4165 
338 114244 18.3848 378 1428 84 19.4422 
339 114921 18.4120 379 14 36 41 19.4679 
340 11 56 00 18.4391 380 14 44 00 19.4936 
341 11 62 81 18.4662 381 14 31 61 19.5192 
342 11 69 64 18.4932 382 14 59 24 19.5448 
343 117649 18.5203 383 14 66 89 19.5704 
384 14 74 56 19.5959 
2 D rna 385 14 82 25 19.6214 
MS 112015 p 1 | 386 14 89 96 19.6469 
346 1197 16 18.601 3 

347 12 04 09 18.6279 387 14 97 69 19.6723 
348 121104 18.6548 388 15 05 44 19.6977 
ш | imo | жик) ж | БЫ! Bra 

350 12 25 00 18.7083 390 . 
‚7350 391 15 28 81 19.7737 
s Я 39 m 18.7617 392 15 36 64 19.7990 
Es 12 46 09 18.7883 393 15 44 49 19.8242 
353 eC 18.8149 394 15 52 36 19.8494 
m 12 60 25 18.8414 395 15 60 25 19.8746 
A 126736 | 18.8680 | 396 156816 | 19.8997 
156 127449 18.8944 | 397 15 76 09 19.9249 
325 158162 | 18.9209 398 158404 | 19.9499 
2 128881 | 18.9473 399 159201 19.9750 
359 129600 | 18.9737 | 400 160000 | 20.0000 


360 
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TABLE А. TABLE or SQUARES AND SQUARE Roors or NUMBERS 
FROM 1 To 1,000.* (Continued) 


Nimes Square Square root | Number Square Square root 
401 160801 | 20.0250 441 194481 | 21.0000 
402 161604 | 20.0499 442 195364 | 21.0238 
403 162409 | 20.0749 443 196249 | 21.0476 
404 163216 | 20.0998 444 197136 | 21.0713 
405 164025 | 20.1246 445 198025 | 21.0950 
406 164836 | 20.1494 446 198916 | 21.1187 
407 165649 | 20.1742 447 199809 | 21.1424 
408 16 6464 | 20.1990 448 200704 | 21.1660 
409 167281 | 20.2237 449 20 16 01 21.1896 
410 168100 | 20.2485 450 202500 | 21.2132 
411 168921 | 20.2731 451 203401 | 21.2368 
412 169744 | 20.2978 452 20 43 04 21.2603 
413 170569 | 203224 453 205209 | 21.2838 
414 171396 | 20.3470 454 206116 | 21.3073 
415 172225 | 20.3715 455 207025 | 21.3307 
416 173056 | 20.398] 456 207936 | 21.3542 
417 173889 | 20.4206 457 208849 | 21.3776 
418 174724 | 20.4450 458 209764 | 21.4009 
419 175561 | 20.4695 459 210681 | 21.4243 
420 17 64 00 20.4939 460 211600 21.4476 
421 177241 | 20.5183 02 
422 178084 | 20.5426 "a а nd d 4983 
423 178929 | 20.5679 463 214369 | 21.5174 
424 179776 | 20.s913 464 21 21.5407 
425 18 06 25 20.6155 465 ao 21.5639 
426 181476 20.6398 466 әр 2175870 
427 182329 | 20.6640 467 pee 21.6102 
428 183184 | 20.6982 Ev А 

468 219024 21.6333 
429 184041 | 20.7123 469 564 
430 184900 | 20.7364 2 E 
470 22 09 00 21.6795 
| RES EX| mosse] ams 
6 472 56 
433 18 74 89 20.8087 473 et Hes 6 
434 18 83 56 20.8327 474 215 E. 
435 18 92 25 20.8567 475 ES pee 
436 19 00 96 20.8806 476 E. oe 2 Du 
437 190969 | 20.9045 477 ania | а 
438 19 18 44 20.9284 478 22 12 р 
439 192721 20.9523 479 ЕЧ eon 
229441 21.8861 
440 193600 | 20.9762 480 2 


3 04 00 21.9089 
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APPENDIX 
TABLE A. TABLE or Squares AND Square Roots oF NUMBERS 
FROM 1 то 1,000.* (Continued) 
Number Square Square root | Number Square Square root 
481 23 13 61 21.9317 521 271441 22.8254 
482 232324 21.9545 522 272484 22.8473 
483 23 32 89 21.9773 523 27 35 29 22.8692 
484 23 42 56 22.0000 524 27 45 76 22.8910 
485 23 5225 22.0227 525 27 5625 22.9129 
486 23 61 96 22.0454 526 27 66 76 22.9347 
487 23 71 69 22.0681 527 27 77 29 22.9565 
488 23 81 44 22.0907 528 27 87 84 22.9783 
489 239121 22.1133 529 279841 23.0000 
490 24 0100 22.1359 530 28 09 00 23.0217 
491 24 10 81 22.1585 531 2819 61 23.0434 
492 2420 64 22.1811 532 28 30 24 23.0651 
493 24 30 49 22.2036 533 28 40 89 23.0868 
494 24 40 36 22.2261 534 28 51 56 23.1084 
495 24 50 25 22.2486 535 28 62 25 23.1301 
496 24 60 16 22.2711 536 28 72 96 23.1517 
497 24 70 09 22.2935 537 28 83 69 23.1733 
498 24 80 04 22.5159 538 28 94 44 23.1948 
499 24 9001 22.3383 539 29 05 21 23.2164 
500 25 00 00 22.3607 540 29 16 00 23.2379 
501 25 1001 22.3830 541 29 26 81 23.2594 
502 25 20 04 22.4054 542 29 37 64 23.2809 
503 25 30 09 22.4277 543 29 48 49 23.3024 
504 25 40 16 22.4499 544 29 59 36 23.3238 
505 25 50 25 22.4722 545 29 70 25 23.3452 
506 25 60 36 22.4944 546 29 81 16 23.3666 
507 25 7049 22.5167 547 29 92 09 23.3880 
508 25 80 64 22.5389 548 30 03 04 23.4094 
509 25 90 81 22.5610 549 30 14 01 23.4307 
510 26 01 00 22.5832 550 30 25 00 23.4521 
511 261121 22.6053 551 30 36 01 23.4734 
512 262144 22.6274 552 30 47 04 23.4947 
513 26 31 69 22.6495 553 30 58 09 23.5160 
514 264196 22.6716 554 30 69 16 23.5372 
515 26 5225 22.6936 555 30 80 25 23.5584 
516 26 62 56 22.7156 556 30 91 36 23.5797 
517 26 72 89 22.7376 557 3102 49 23.6008 
518 26 83 24 22.7596 558 311364 23.6220 
519 2693 61 22.7816 559 31224 81 23.6432 
22.8035 560 313600 23.6643 


27 04 00 
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TABLE А. TABLE or Squares AND Square Roors оғ NUMBERS 
FROM 1 To 1,000.* (Continued) 
Number Square Square root | Number Square Square root 
561 314721 | 25.685: | 601 361201 | 24.3153 
562 315844 23.7065 | 602 36 24 04 24.535 
563 316969 | 23.7276 603 363609 | 24.5560 
564 318096 | 23.7487 | 604 364816 | 24.576 
565 319225 | 23.7697 | 605 366025 | 24.5967 
566 320356 | 23.7908 606 367236 | 24.6171 
567 321489 | 23.8018 607 368449 | 24.6374 
568 322624 | 23.8528 608 369664 | 24.6577 
569 323761 | 23.8537 609 37 08 81 24.6779 
570 324900 | 23.8747 610 37 2100 24.6982 
571 326041 | 23.8956 | єп 37 33 21 24.7184 
572 327184 | 23.9165 | 612 37 45 44 24.7385 
573 328329 | 23.9574 613 37 57 69 24.7588 
574 329476 | 23.9583 614 376996 | 24.7790 
575 330625 | 23.9792 615 378225 | 24.7992 
576 331776 | 24.0000 616 379456 | 24.8193 
577 332929 | 24.0208 617 380689 | 24.8395 
578 334084 | 24.0416 | 618 381924 | 24.8596 
579 335241 | 24.0624 | 619 38 31 61 24.8797 
580 336400 | 24.0832 620 384400 | 24.8998 
581 337561 24.1039 6 24.9199 
582 338724 | 24.1247 en 38 58 a 24.9399 
583 33 98 89 24.1454 | 63 38 81 29 24.9600 
584 3410 56 24.1661 624 38 93 76 24.9800 
585 34 22 25 24.1868 | (5 39 06 25 25.0000 
586 343396 | 24.2074 626 391876 | 25.0200 
587 344569 | 24.228] | буу 393129 | 25.0400 
588 345744 | 242487 | бу 394384 | 25.0899 
589 346921 24.2693 | бєз 25.0799 
590 34 8100 24.2899 | сш “0998 
| во 39 69 00 25.099 
591 349281 | 24.3105 6 7 
592 350064 | зи | 61 99424 | 25.1396 
593 351649 | 24.3516 633 ien | ise 
594 35 28 36 24.3721 634. ei “1794 
: 40 19 56 25.179 
595 35 40 25 24.3926 635 2 
40 32 25 25.199! 
596 355216 | 24.4131 636 40449 25.2190 
597 35 6409 24.4336 637 40 57 _ 5.2389 
598 357604 24.4540 638 40 2 к 
7044 25.2587 
599 35 88 01 24.4745 639 40 83 2784 
600 360000 | 24.4949 640 д | 2s. 


40 96 00 25.2982 
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APPENDIX 
TABLE A. TABLE oF SQUARES AND Square Roots or NUMBERS 
FROM 1 то 1,000.* (Continued) 
Number Square | Number Square Square root 
641 4108 81 681 46 37 61 26.0960 
642 412164 682 46 5124 26.1151 
643 413449 683 46 64 89 26.1343 
644 414736 684 4678 56 26.1534 
645 41 60 25 685 46 92 25 26.1725 
646 4173 16 686 47 05 96 26.1916 
647 41 86 09 687 47 19 69 26.2107 
648 419904 688 473344 26.2298 
649 421201 689 474721 26.2488 
650 42 2500 690 47 6100 26.2679 
651 423801 691 477481 26.2869 
652 42 5104 692 47 88 64 26.3059 
653 42 64 09 693 4802 49 26.3249 
654 42 77 16 694 48 16 36 26.3439 
655 42 90 25 695 48 30 25 26.3629 
656 43 03 36 696 484416 26.3818 
657 43 16 49 697 48 5809 26.4008 
658 43 29 64 698 48 72 04 26.4197 
659 43 42 81 699 48 86 01 26.4386 
660 43 56 00 700 49 00 00 26.4575 
2 701 49 14 01 26.4764 
e i кз ré 702 49 28 04 26.4953 
663 43 95 69 703 49 42 09 26.5141 
664 44 08 96 704 49 56 16 26.5330 
665 412225 705 49 70 25 26.5518 
666 4135 56 706 498436 26.5707 
707 49 98 49 26.5895 
бол 18 708 5012 64 26.6083 
44 62 24 8 
pos 4175 61 709 50 26 81 26.6271 
eo d 89.00 710 504100 | 26.6458 
711 505521 26.6646 
671 E y n 712 50 69 44 26.6833 
672 152929 713 5083 69 26.7021 
Si 45 42 76 714 50 97 96 26.7208 
675 45 5625 715 511225 26.7395 
676 45 69 76 716 51 26 56 26.7582 
677 45 83 29 717 514089 26.7769 
678 45 96 84 718 515524 26.7955 
yu 46 10 41 719 516961 26.8142 
46 24 00 720 518400 | 26.8328 


680 ` 1 
„жыны — en a eee UR 


* Portions of Table A have been reproduced from J. W. Dunlap and A. K. Kurtz: 
Po Statistical Nomographs, Tables, and Formulas, World Book Company, 


Handbook 
New York ( 


1932), by permission of the authors. 


208 INTRODUCTION TO EXPERIMENTAL METHOD 


TABLE A. TABLE or SQUARES AND Square Roots or NUMBERS 
FROM 1 To 1,000.* (Continued) 


Number Square Square root | Number Square Square Foot 
721 5198 41 26.8814 | 761 579121 27:587 
722 52 12 84 26.8701 | 762 58 06 44 Eames 
723 522729 | 26.8887 | 763 582169 ope 
724 524176 26.9072 764 58 36 96 Mr 
725 52 56 25 26.9258 765 58 52 25 27.658 
726 527076 | 26.9444 766 586756 | 27.6767 
727 528529 | 269629 767 588289 | 27.6948 
728 529984 | 269815 768 58 98 24 27.7128 
729 531441 | 27.0000 769 5913 61 27.7308 
730 532900 | 27.0185 770 59 29 00 27.7489 
731 534361 | 27.0370 771 59 44 41 27.7669 
732 535824 | 27.0555 772 595984 | 27.7819 
733 537289 | 270740 773 597529 | 27.8029 
734 538756 | 27.0924 TA 59 90 76 27.8209 
735 5402 25 27.1109 775 60 06 25 27.8388 
736 541696 | 27.1293 776° 602176 | 27.8568 
737 543169 | 27.1477 777 60 37 29 27.8747 
738 514644 | 27.1662 778 60 52 84 27.8927 
739 546127 | 27.1846 779 60 68 41 27.9106 
740 547600 | 27.2029 780 608400 | 27.9285 
741 549081 27.2213 781 27.9464 
742 5505 64 27.2397 | 782 a a а 27.9643 
743 552049 | 27.2580 783 61 30 89 27.9821 
744 553536 27.2764 784 61 46 56 28.0000 
745 55 5025 27.2947 785 61 62 25 28.0179 
746 556516 | 27.3130 786 617796 28.0357 
747 55 8009 27.3313 787 61 93 69 28.0535 
748 559504 27.3496 788 62 09 44 28.0713 
749 561001 | 27.3679 789 622521 | 28.0891 
750 562500 | 27.3861 790 62 41 00 28.1069 
751 564001 27.4044 
752 565504 | 27.4226 | 221 Mm | mus 
753 567009 | 27.4408 793 62.88 49 28.1603 
754 568516 | 27.4591 794 63 04 36 28.1780 
755 57 0025 27.4773 795 63 20 25 28.1957 
756 571536 | 27.4955 796 633616 | 28.2135 
757 573049 | 27.5136 797 635209 | 282312 
758 57 45 64 27.5318 798 63 68 04 8.2489 
759 576081 | 27.5500 799 63 8401 28.2666 
760 577600 | 27.5681 | во 640000 | 28.2845 
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APPENDIX 


TABLE А. TABLE oF SQUARES AND Square Roots.oF NuMBERS 


From 1 то 1,000.* (Continued) 


Number Square Square root Square | Square root 
801 64 1601 28.3019 70 72 81 29.0000 
802 64 32 04 28.5196 70 89 64 29.0172 
803 64 48 09 28.3373 7106 49 29.0345 
804 64 64 16 28.3049 71 23 36 29.0517 
805 64 80 25 28.3725 71 40 25 29.0689 
806 64 96 36 28.3901 715716 29.0861 
807 65 12 49 28.4077 717409 29.1033 
808 65 28 64 28.4253 719104 29.1204 
809 65 44 81 28.4429 72 08 01 29.1376 
810 65 61 00 28.4605 7225 00 29.1548 
811 65 7721 28.4781 724201 29.1719 
812 65 93 44 28.4956 72 59 04 29.1890 
813 66 09 69 28.5132 72 76 09 29.2062 
814 66 25 96 28.5307 7293 16 29.2233 
815 66 42 25 28.5482 731025 29.2404 
816 66 58 56 28.5657 73 27 36 29.2575 
817 66 74 89 28.5832 73 44 49 29.2746 
818 669124 28.6007 73 6164 29.2916 
819 67 07 61 28.6082 73 7881 29.3087 
820 67 24 00 28.6356 73 96 00 29.3258 
821 67 4041 28.6531 741321 29.3428 
822 67 56 84 28.6705 74 30 44 29.3598 
823 67 73 29 28.6880 7447 69 29.3769 
824 67 89 76 28.7054 74 64 96 29.3939 
825 68 06 25 28.7228 748225 29.4109 
826 68 22 76 28.7402 74 99 56 29.4279 
827 68 39 29 28.7576 75 16 89 29.4449 

828 68 55 84 28.7750 75 3424 29.4618 
829 68 7241 28.7924 75 5161 29.4788 
830 68 89 00 28.8097 75 69 00 29.4958 
cmn 6905 61 28.8271 75 86 41 29.5127 
832 69 22 24 28.8444 76 03 84 29.5296 
833 69 38 89 28.8617 76 21 29 29.5466 
834 69 55 56 28.8791 763876 29.5635 
835 697225 28.8964 765625 29.5804 
836 69 88 96 28.9137 7673 76 29.5973 
837 70 05 69 28.9310 769129 29.6142 
838 70 22 44 28.9482 77 08 84 29.6311 
839 703921 28.9655 772641 29.6479 

70 56 00 28.9828 774400 29.6648 


840 
бап f Table A have been reproduced from J. W. Dunlap and A. K. Kurtz: 


* portions o! zu 
book of Statistical Nomographs, Tables, and Formulas, World Book Company 


Hand ds 
OS York (1932), by permission of the authors. 


210 INTRODUCTION TO EXPERIMENTAL METHOD 


TABLE А. TABLE or Squares AND Square Roors or NUMBERS 
FROM 1 To 1,000.* (Continued) 

Number Square Square root | Number Square Square root 
881 77 61 61 29.6816 921 84 82 41 30.3480 
882 777924 29.6985 922 85 00 84 30.3645 
883 77 96 89 29.7155 923 85 19 29 30.3809 
884 78 14 56 29.7321 924 85 37 76 30.3974 
885 783225 29.7489 925 85 56 25 30.4138 
886 78 49 96 29.7658 926 85 74 76 30.4302 
887 78 67 69 29.7825 927 85 93 29 30.4467 
888 78 85 44 29.7993 928 861184 30.4631 
889 790321 29.8161 929 86 30 41 30.4795 
890 792100 29.8329 930 86 49 00 30.4959 
891 7958 81 29.8496 931 30.5123 
892 79 56 64 29.8664 932 » 4 » 30.5287 
893 79 74 49 29.8831 933 87 04 89 30.5450 
894 79 92 36 29.8998 934 87 23 56 30.5614 
895 80 10 25 29.9166 935 87 42 25 30.5778 
896 80 28 16 29.9333 936 87 60 96 30.5941 
= 804609 | „29.9500 937 877969 | 30.6105 
898 80 64 04 29.9666 938 87 98 44 30.6268 
899 80 82 01 29.9833 939 881721 30.6431 
900 81 00 00 30.0000 940 88 3600 30.6594 
27 а 7 бл yd 94 88 54 81 30.6757 
903 : 942 88 73 64 30.6920 

81 5409 30.0500 943 88 92 49 30.7083 
en 817216 | 30.066 944 891136 | 30.7246 
peo ai С ap 945 893025 | 30.7409 
907 aras RES 946 89 49 16 30.7571 
908 82 44 64 30 947 89 68 09 30.7734 
1330 948 6 
909 82 62 81 30.1496 а 89 87 04 30.789 
910 82 81 00 30.1662 р 90 06 01 30.8058 
90 25 00 30.8221 
End тл Wie | bm 904401 | 30.8383 
: 952 
913 833569 | 30.2159 95 906304 | 30.8545 
914 835396 | 30.2324 954 90 82 09 30.8707 
915 83 7225 30.2490 955 A > 5; eod 
916 839056 | 30.2655 956 025 30.9031 
91 39 36 30.9192 
917 84 08 89 30.2820 957 Ep ae 
918 84 27 24 30.2985 958 9177 64 Pt 
919 844561 | 30.3150 959 30.9516 
919681 77 
920 84 64 00 30.3315 960 30.96 


921600 30.9839 
* Portions of Table A have been reproduced from 
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APPENDIX 


TABLE A. TABLE or Squares AND SQUARE Roots or NUMBERS 


FROM 1 то 1,000.* 


Number Square 


(Concluded) 


961 923521 
962 92 54 44 
963 92 73 69 
964 92 92 96 
965 93 1225 
966 93 31 56 
967 93 50 89 
968 93 70 24 
969 93 89 61 
970 94.09 00 
971 9428 41 
972 94 47 84 
973 94 67 29 
974 94 86 76 
975 95 06 25 
976 95 25 76 
977 95 45 29 
978 95 64 84 
979 95 8441 
980 96 04 00 


prod 


* Porti A have been re 
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Square root | Number Square Square root 
31.0000 981 96 23 61 31.3209 
31.0161 982 96 43 24 31.3369 
31.0322 983 96 62 89 31.3528 
31.0483 984 96 82 56 31.3688 
31.0644 985 97 02 25 31.3847 
31.0805 986 97 21 96 31.4006 
31.0966 987 97 41 69 31.4166 
31.1127 988 97 61 4t 31.4325 
31.1288 989 97 8121 31.4484 
31.1448 990 98 01 00 31.4643 
31.1609 991 98 20 81 31.4802 
31.1769 992 98 40 64 31.4960 
31.1929 993 98 60 49 31.5119 
31.2090 994 98 80 36 31.5278 
31.2250 995 99 00 25 31.5436 
31.2410 996 99 20 16 31.5595 
31.2570 997 99 40 09 31.5753 
31.2730 998 99 6004 31.5911 
31.2890 999 99 8001 31.6070 
31.3050 1000 1000000 31.6228 


uced from J. W. Dunlap and A. K. Kurtz: 


Formulas, World Book Company, 


212 


INTRODUCTION TO EXPERIMENTAL METHOD 


TABLE B.* LEVEL or CONFIDENCE For t 


(Table of ż) 


Degrees of freedom E 
(Ni —1) + (№. — 1) 5% level | 1% level 
1 12.71 63.66 
2 4.30 9.92 
3 3.18 5.84 
4 2.78 4.60 
5 2.57 4.03 
6 2.45 3.71 
7 2.36 3.50 
8 2.31 3.36 
9 2.26 3.25 
10 2.23 3.17 
11 2.20 3.11 
12 2.18 3.06 
13 2.16 3.01 
14 2.14 2.98 
15 2.13 2.95 
16 2.12 2.92 
17 2.11 2.90 
18 2.10 2.88 
19 2.09 2.86 
20 2.09 2.84 
21 2.08 2.83 
22 2.07 2.82 
23 2.07 2.81 
24 2.06 2.80 
25 2.06 2.79 
26 2.06 2.78 
27 2.05 2.77 
28 2.05 2.76 
29 2.04 2.76 
30 2.04 2.75 
40 2.02 2.71 
50 2.01 2.68 
100 1.98 2.63 
500 1.96 2.59 
1000 1.96 2.58 


* Table B is abridged from Table IV of Fi p 


, published by Oliver and Boyd, Ltd., Edinb 
Т Me Supplementary entries were take: 


Taste C.* 


TABLE ок CHI SQUARE (x?) 


(Chi squares appear in the body of the table) 


Bin | | | 
‘at P= 99 98 95 90 80 20 40 | 05 .02 D 
freedom 
1 000157 | .000628 | .оозоз .455 | 1.074| 1.642 | 2.706 | 3.841| 5.412 | 6.035 
2 “0201 “0404 “103 Р 210 | 4.605 | 3.901 | 7.824 | 0.210 
3 "hs “185 1352 642 | 6:251 | 7.818 | 9.837 | 11.341 
4 E “490 T 989 | 7.779 | 9:488 | 11.008 | 13:277 
8 E “752 11145 289 | 0:236 | 11.070 | 13.388 | 15.086 
6 872 1.184 1.635 558 | 10.645 | 12.592 | 15.033 | 16.812 
1 Lm 1: 504 2107 803 | 12:017 | 14.007 | 16.622 | 18.475 
8 1-646 2.082 2.133 030 | 13.302 | 15.507 | 18.108 | 20.090 
10 2,558 3:059 31940 


* Table С is геј 
and publishers. 
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Oliver & Boyd, Ltd., Edinburgh, by permission of the author 
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TABLE D.* 


TO EXPERIMENTAL METHOD 


T THE 
CANCE А! 
CORRELATION Corrricrents (r) REQUIRED ron SIGNIFI 

5% AND 1% LEVELS OF CONFIDENCE 


Degrees of freedom 5% level | 1% level 
1 .997 1.000 
2 .950 .990 
3 .878 .959 
4 811 917 
5 ‚7154 .874 
6 -707 .834 
7 -666 .798 
8 .632 .765 
9 .602 .735 

10 .576 .708 
11 .553 .684 
12 .532 .661 
13 .514 641 
14 .497 .623 
15 .482 .606 
16 .468 .590 
17 .456 .575 
18 .444 .561 
19 .433 .549 
20 .423 .537 
21 .413 .526 
22 .404 .515 
23 .396 .505 
24 .388 .496 
25 .381 .487 
26 .874 .478 
27 .367 470 
28 -361 .463 
29 .355 .456 
30 -349 .449 
40 304 393 
50 273 354 
100 -195 254 
500 -088 115 
1000 062 0 
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a lise judgment, 77, 78 
[ы бш, journal articles, form for, 37 
po ity cage, 108, 124 
[om wheel, 108, 124 
до кебине, 108, 124 
Кый кр method of, 94-98 
ysis, multiple-factor, 57 

of problems, 38, 39 

results of, 39 
$ of variance, 57 

ndrews, T. G., 8, 15, 42, 52, 57, 62, 67, 
572 105, 106 

ticipation, 72 
Apparatus, 39, 107-128 

characteristics of, 107-108 

electrical circuits, 125-128 

lists of, 108-125 

multiple-choice, 114-115, 124 

reaction-time, 118-1 19, 125 

Singerman color-mixture, 120, 125 

uses of, 123-125 
Applied design, 12 
Apprehension, span o 
Armchair experimentation, 
Ataxiameter, 108, 124 
Audiometer, 108, 124 
Authority, method of, 26 
Automatograph, 108, 124 
Average deviation, 144, 145 
Average error, method of, 73-15 


f, 185-195 
25 


B 


Bacon, F., 45, 90 

Ball, J., 104 

Barany chair, 109, 124 

Barker, W. S., 130 

Bartley, 8. H., 5, 15 
Beat-frequency oscillator, 109, 124 


Behaviorism, 10 
Bell Adjustment Inventory, 109, 124 


Benjamin, A. C., 33, 42, 50, 51, 58, 67 
Binet, A., 82 

Black, M., 8, 15 

Boring, E. G., 19, 23, 28, 31, 87 
Braun, H. W., 130 

Bugelski, B. R., 6, 8, 15 
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Cattell, J. McK., 82, 87 
Causal relationship, 20 
Cause, 16, 17 

bases for, 19 

causal sequence, 16, 20 

multiple, 18 
Central tendency, 139, 143 
Chapanis, A., 12, 15 
Chave, E. J., 82, 88 
Chi square, 156-159 
Chronoscope, 109, 124 
Classification, 11 
Cohen, М. R., 11, 15, 17, 24, 27, 30, 31, 

33, 42, 51, 105, 136 

Color wheel, 109, 124 
Common sense, 6, d 
Concomitant variation, 8 

method of, 8, 100-103 
Conditioning unit, 109, 124 
Conducting of experiments, 39, 129-133 
Confidence, level of, 152, 155, 156 
Constancy of conditions, method of, 64 
Constant error, 74, 75 
Constant method, 75-77 
Constant-stimuli method, 75-77 
Constant-stimulus differences, method of, 

75-11 

Contiguity, 19, 20 
Contradiction, principle of, 29 
Contrariety, 30 
Controls, 7, 8, 11, 39, 58, 59 

group, 60-63 

(See also Experiments, techniques for 

controlling) 
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Cook, S. W., 63 
Coordinates, 168-169, 175-176 
Correlation, 160-165 
partial, 57 
product-moment, 163-165 
rank-difference method, 161-163 
Counterbalancing method, 64-66 
Cresswell, J. R., 9, 15 
Critical ratio, 153 
Cruze, W. W., 6, 15 
Curtis, J. W., 101-102, 106 
Curves, normal, 173 
smoothing, 172 
(See also Graphs) 
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Data, aids in collecting, 131 
continuous, 167 
discontinuous, 167 
forms for collecting, 132, 133 
Davis, R. C., 128 
Deductive logie, 8-11, 25-26 
Delayed effect, 19 
Depth-perception box, 109, 124 
Determinism, principle of, 17 
psychic, 17 
Deutch, M., 63 
Deviation, mean, 144-145 
Standard, 145-146 
Difference, method of, 91-94, 185-190 
Dynamometer, 109, 124 
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Ebbinghaus, H., 12 
Effect, 16 
delayed, 19 
Electrical stimulator, 
126 
(See also Electrostimulator) 
Electrocardiograph, 109, 124 
Electromyograph, 109, 124 
Electronie voice key, circuit diagram of, 
127, 128 
Electrostimulator, 110, 124 
Empirical а R 173 
Hpiscotister, 110, 
Bes appearing intervals, method of, 80, 
81 


circuit diagram of, 
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Equation method, 73-75 
Ergograph, 110, 124 
Error, constant, 74, 75 

of habituation, 72 

of measurement, 14 

standard (see Standard error) 

in using symbols, 30, 31 

variable, 74, 75 0 
Excluded middle, principle of, 29, T 
Experimental designs, types of, 90-1 

(See also Research designs) 
Experimental group, 60, 61, 62 
Experimental method, 38 

application of, 185-195 

When not applicable, 38 
Experimenter, 111, 124 
periment conducting of, 39, 129-133 

learning, 84 

retention, 85 

techniques for controlling, 64-67 

training, transfer of, 85, 86 
Explanation, by description, 22, 23 

by familiarization, 22 

hierarchy of, 23 

by labeling, 20 

meaning of, 16 

mystical, 4, 9 

by statement, of inferential procedure; 
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of purpose, 21-92 

Expression, method of, 68 
Eye-movement camera, 111, 124 
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Factorial method, 83-86, 100, 152 
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escription of, 31 

Feigl, H., 22, 24 
Forms, 129-131 

data sheet, 132, 133 

research design, 129, 131 


"ormulation of problems, 34-37 
Frame of reference, 11, 23 
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сопа] method, 83-85, 100 
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Gall, Е. J., 27, 28 
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Garner, W. R., 12, 15 
Garrett, Н. E., 146, 151, 159 
General semantics, 28, 31 
Generalization, 9, 10, 11 
notes on, 179-181 
Graphs, construction of, 166-179 
bar, 167 
circle, 166-167 
line, 170-173 
Guilford, J. P., 69, 88 
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Habituation, errors of, 72 
Hayakawa, 5. I., 28, 31 
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Lenst noticeable difference, method of, 69- 
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Lie detector, 68 
Limens, 70, 71 
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of variables, 54-57 
Logie, 8, 31 
deductive, 8-11, 25, 26 
inductive, 8-11 
logical inference, 9 
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McDougall, W., 20, 24 
Matched-group technique, 62, 63 
Matched-pairs technique, 62 
Mean, 141, 142, 147-151 

Mean deviation, 144-145 

Mean gradation, method of, 80, 81 
Meaning, 31 

Measurement, errors of, 14 
Median, 140, 141, 142 
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Minimal change, method of, 69-73 

Mirror tracing board, 113-114, 124 

Mode, 139, 140, 142 

Morgan, C. T., 12, 21, 24 

Morgan, L., 180-181 

Miiller-Lyer illusion, 114, 124 

Multiple causation, principle of, 17 

Multiple-choice apparatus, 114-115, 194 

Multiple-factor analysis, 57 
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90, 106, 146, 151, 165 
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Null hypotheses, 47, 48 
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Observed relationship, 172 
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O'Conner Finger Dexterity Test, 115, 124 
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Olfactometer, 115-116, 125 

One-way vision screen, 116, 125 
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two-valued, 30 

Oscillator, beat-frequency, 109, 124 

Oscilloscope, 116, 125 

“Ought” questions, 38 
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а priori, 138 
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Scientific, 4 
solution of, 7 
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